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(54) Tide: MOLECULAR COMPUTER 

(57) Abstract 

A molecular computer is formed by 
establishing arrays of spaced-apart input 
(12) and output pins (14) on opposing 
sides of a (10), injecting moleware (16) 
in solution into the containment and 
then allowing the moleware to bridge the 
input and output pins. Moleware includes 
molecular alligator clip-bearing 2-, 3-, 
and molecular 4-, or multi-terminal 
wires (30, 36, 40, respectively), carbon 
nanotube wires (80), molecular resonant 
tunneling diodes (32, 38), molecular 
switches (90), molecular controllers 
(42) that can be modulated via external 
electrical or magnetic fields, massive 
interconnect stations (44) based on single 
nanometer-sized particles, and dynamic 
and static random access memory (DRAM 
and SRAM) components composed 
of molecular controller/nanoparticle or 

fullerene hybrids (46). The current-voltage characteristics that result from the bridging between input and output arrays can be ascertained 
using another computer to identify the bundles of inputs and corresponding outputs that provide a truth table for the specific functions of 
the computer. 
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MOLECULAR COMPUTER 

1. Priority Statement: 

We claim the benefit of the priority date of US Provisional Patent application 
60/116,714, filed January 21,1999, which is incorporated herein by reference. 
5 2. Field of the Invention: 

The present invention relates generally to computer architecture, and, more specifically 
to a computer that uses molecules as functional units (e.g. logic gates and memory cells). 
3. Background of the Invention 

The investment by society in computer technology has been astonishing in both its rate 
10 of increase and its extent. In less than three decades, the personal computer, for example, has 
gone from experimental prototype to being an essential tool of business. Demands for 
computers with greater and greater capabilities to perform more and more tasks continue 
unabated. Heretofore, better computers have resulted from increased miniaturization, among 
other improvements. 

1 5 Presently, however, we do not have a viable technology for our near future computer 

needs. Although Moore's law (an accurate empirical law at this time) predicts the doubling 
of computer power every 1 8 months, this trend cannot continue. Digital computers are 
presently based on silicon technology. More precisely, very large scale integration (VLSI) is 
a lithographic technology, and although silicon is indeed quite important, Moore's Law is 

20 essentially lithography driven. The law of diminishing returns will eventually conquer 
Moore's Law, perhaps by 2005, when the cost of an integrated-circuit fabrication factory will 
become exorbitant and spell the demise of the growth of VSLI-based computer systems. 

Other than standard logic and memory tasks, a technique one might choose for an ideal 
post- VLSI computer system would be to utilize a non-lithographic approach to construction, 

25 e.g., a directed self-assembly, so there would either be a vast redundancy or the system should 
have fault tolerance through dynamic fault reduction. Another property for such a computer 
would be an ability to be self-reconfigurable, that is, it should be able to dynamically 
reconfigure interconnects in response to inputs, or else it will also fall victim to the incessant 
demands for interconnects. Finally, this post-VLSI computer would be innovative: able to 

30 reconfigure architectures not previously experienced. 
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There remains a need, therefore, for a new computer technology that provides the 
advantages of self-assembling construction and greater processing capability that can be 
reconfigured readily. 

SUMMARY OF THE INVENTION 
5 The present m% ention is a device having a multiplicity of input pins and a multiplicity 

of output pins on its external surface. The interior is composed of a self-assembled array of 
specifically selected and adapted molecules, called "moleware", bridging the inputs and 
outputs. Initially, this present computer is in a blank state; that is, nothing is known about the 
electrical-signal-transterring relationship between the input and output pins. A voltage is 
10 applied to each of a series of bundles of inputs. The outputs are searched, also in bundles, to 
" determine what outputs have signals running through them. Using a computer to do the 
searching, sets of bundles of inputs and outputs will eventually be identified that can be used 
to constitute a truth or partial truth table for the computer. Electrical or magnetic fields can 
also be applied across the container to increase configuration possibilities. 
1 5 The present invention, in a preferred embodiment, may take the form, for example, of 

a one cubic centimeter box that contains 1000 metallic inputs (m), 1000 outputs (n), and 100 
different learning inputs (1). The box will contain an intelligently self-assembled array of 10 20 
pre-designed active and passive components ("moleware") including molecular alligator clip- 
bearing 2-, 3-, and molecular 4-terminal wires, molecular resonant tunneling diodes, molecular 
20 S witches,molecularcontrollersthatcanbe<x)ntrolledviaextemalelectricalormagneticfields, 

massive interconnect stations based on single nanometer-sized particles, dynamic or static 
random access memory (DRAM or SRAM) components composed of molecular 
controller/nanoparticle or fullerene hybrids. Moreover, the present molecular computer, once 
formed, can be further modified by new interconnect routes via electrochemically induced 
25 cross linking of the nanoparticles or by "burning out" components through large induced 
fields, analogous to the operation of a field programmable gate array (FPGA). Arrays of these 
molecular computers can be coupled using standard interconnect methods to form massive 
molecular computer arrays. 

The present molecular computer has a number of advantages: 



BNSDOCID: <WO O044O94A1_l_> 



WO 00/44094 PCT/US00/01360 

3 

It can be teachable. The system can be trained by forcing the correct output for a given 
input by varying the operational inputs until consistency is achieved. The output as a function 
of input can be auto verified. 

It can be reconfigurable. Either by successive retraining or by burning out specific 
5 functions, the system can be changed. 

It can possess logic. The truth table for the molecular computer would not be known 
a prion, bui would be determinable once it has been prepared or on the fly as self-assembly 
takes place 

! t can possess memory. Semiconductor nanoparticles such as CdS or CdSe coated with 
1 0 molecular control elements, or C 60 surrounded by controller elements, or even nanometer-scale 
metallic panicles sufficiently small so as to exhibit sizeable Coulomb blockade, will be 
pre tunned and then permitted or induced to assemble themselves as part of the network of the 
present molecular computer. In the situation where an electromagnetic field is applied, the 
controllers will open thereby permitting the semiconductive or metallic particle to store a 
1 5 charge, hence acting as a DRAM or SRAM component. 

It will have an intrinsic extremely high fault tolerance because of the ability to use their 
terminals (input, outputs, and learning inputs) as rewiring control leads. Therefore, this 
embodiment takes advantage of the inmense number of functions that can be make with their 
terminals. For example, for binary operation, 1000 inputs yield 2 1000 posible input 
20 combinations. Therefore with 1 000 possible outputs yield a total of 1 0 32256000 0000 where 
the number of digits in the exponent is 304. 

The system has dynamic fault reduction capabilities. Unlike VLSI, where the 
interconnect structure is rigid, the present molecular computer can be reprogrammed to 
eliminate undesired and inoperative fragments since the interconnect topology can be rewired 
25 at any time by applying sufficiently strong fields to regions of the molecular computer where 
reprograrnming is desired. 

The system lends itself to expansion. Arrays of molecular computers according to the 
preferred embodiment described above can be formed using standard interconnect methods 
to form massive computer arrays. 
30 It is also possible to program the present computer in other than a binary digital mode, 

such as for example, an analog or multilevel (semi-analog) system. Perhaps programming 
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becomes more formidable; however, data storage increases significantly and makes the 
programming challenges acceptable for certain applications. 

The design of a molecular computer according to a preferred embodiment of the 
present invention takes into consideration that a very large percent of the fabricated moleware 
5 components may be defective. Hence, the testing will be more extensive and done in multiple 
stages in the fabrication and assembly. Molecular computers made according to the present 
process will be tested individually and in place. Testing is performed preferably with a 
high-speed computer or supercomputer initially or, eventually, with the present molecular . 
computer, due to the computational demands for rapidly sorting out the relationship between 
10 input and output pins. 

An important feature of the present invention is that, unlike other approaches to 
making computers from molecules, specific placement ofnanometer-sized molecular elements 
is not needed. Moleware is simply added in bulk in a dilute solution and given a chance to 
form links or "bridges" between inputs and outputs. The excess solvent is removed leaving the 
1 5 moleware components after self-assembly. Additionally, the moleware can be inserted using 
an evaporation process wherein the molecules are evaporated into the container wherein they 
self-assemble. The moleware is selected and adapted to form stable links that will remain in 
place during normal operating conditions. The molecular computer has then produced inputs 
and outputs with the necessary relationships; it remains the task of another computer to find 
20 which groups of input pins have what relationship to which output pins. Once the input and 
output pin relationships have been identified, the computer can then be used just as surely as 
if the moleware had been put carefully into position. 

Another important feature of the present invention is that, because the present 
moleware is capable of transferring voltages comparable to current integrated circuits, the 
25 adaptationrequired to integrate molecular computers into current electronic devices is straight- 
forward. 

Still another important feature of the present invention is that it is highly fault tolerant. 
Because there are vast numbers of molecular paths that are possible between inputs and 
outputs, it will not matter if a very large percentage of them do not work. Enough of them will 
30 work to permit a truth table to be found. 
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Another important feature of the present invention is the ability to reconfigure it - to 
increase, change or break connections in the bridging between inputs and outputs - simply by 
subjecting it to electrical or magnetic fields long enough and strong enough to cause the 
moleware to realign itself. These fields can be sufficiently local so as not to affect all 
5 moleware in the container. 

Still another feature of the present invention is that, although each computer will be 
unique, all can be "trained" to perform the same functions once the necessary relationships 
between inputs and outputs are found. 

Other features and their advantages will be apparent to those skilled in the art of 
1 0 nanotechnology and molecular computers from a careful reading of the Detailed Description 
of Preferred Embodiments accompanied by the following drawings. 

DETAILED DESCRIPTION OF THE DRAWINGS 
In the drawings: 

Fig. 1 A illustrates in schematic form a molecular computer according to a preferred 
1 5 embodiment of the present invention; 

Fig. IB illustrates four species of moleware for use inside the containment of the 
molecular computer; 

Fig. 2A illustrates in schematic form the inputs/outputs for a molecular computer 
according to a preferred embodiment of the present invention; 
20 Fig. 2B illustrates a detailed perspective view of the inputs/outputs; 

Fig. 3 illustrates a two-dimensional projection of a detail of a cross sectional view of 
the input/output arrangement, according to a preferred embodiment of the present invention; 

Fig. 4 illustrates in chemical symbols and schematic form the formation of molecular 
alligator clips on the end of molecular wires and its attachment by sulfur bonding to metal 
25 surfaces, according to a preferred embodiment of the present invention; 

Fig. 5 illustrates two additional molecular alligator clips, according to alternative 
preferred embodiments of the present invention; 

Fig. 6 illustrates in chemical symbols a molecular wire with alligator clips according 
to a preferred embodiment of the present invention; 
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Fig. 7 illustrates a controller molecule in two orientations, in the "off" position on the 
left and in the conductive position on the right, according to a preferred embodiment of the 
present invention; 

Fig. 8 illustrates the connection to a gold nanoparticle connected to an electrode via 
5 a bi-functional molecular wire, according to a preferred embodiment of the present invention; 

Fig. 9 illustrates a nanoparticle with connecting molecules attached to activate its 
surface and facilitate interconnection with other moleware, according to a preferred 
cniKKlimcnl of the present invention; 

Fig 10 illustrates a molecular dynamic random access memory composed of a 
10 molecular controller and molecular capacitor, according to a preferred embodiment of the 
present invention: and 

Fig. 1 1 illustrates a preferred insulator nanoparticle; 

Fig. 12 illustrates modular preassembly of the moleware according to a preferred 
embodiment of the present invention; 
15 Fig. 13 illustrates two-, three- and four-terminal molecular moleware species, 

according to a preferred embodiment of the present invention; and 

Fig. 14 illustrates a two-dimensional array for a molecular computer according to an 
example of an embodiment of the present invention. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
20 Figs. 1 A and 1 B illustrates the configuration of a molecular computer according to a 

preferred embodiment of the present invention. The computer comprises a containment, 
illustrated here in the form of a container 10 with input 12 and output ports 14 (I/O ports) and 
moleware 16 assembled inside the containment. The shape of container 10 is not critical as 
long as it provides acces to input ports 12 and output ports 14. Current or a field gradient 18 
25 may be applied across container 1 0. Additionally, a two-dimensional chip-based scheme could 
be used wherein moleware branches laterally across I/O locations. The term "moleware" is 
intended to refer to nanometer-scale objects (less than 1 000 nanometers in diameter) that serve 
as part of a computing device; i.e., nanometer-scale computer "hardware" (see Fig. IB). In 
general, moleware consists of molecules, clusters of molecules, nanoclusters of atoms, and 
30 combinations of these, selected for particular characteristics and adapted to interconnect in 
specific ways. The moleware is preassembled in standard chemical lab ware containers, 
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preferably in dilute solutions, and is injected into the containment in a controlled sequence that 
allows the moleware to bridge the input and output ports. The supporting matrix for the input 
and output pins could be a rectilinear two or three dimensional grid fabricated on substrates 
made, for example, of glass or silicon. However a substrate-less approach is also possible. 
5 The three-dimensional grid can be formed using multilevel fabrication and micro- 
electromechanical release structures, and moleware can be deposited by evaporation. 

Nominally, the present computer can be made, for example, of a one cubic centimeter 
containment with 1 000 input and 1 000 output metalic leads. The exact shape of the computer 
and the number of leads is not critical. All leads, for example, can be on the same side of the 
1 0 containment. The moleware will comprise an intelligently assembled array of about 1 0 20 pre- 
designated active and passive components, called herein "moleware", including molecular 
alligator clip-bearing 2-terminal wires 30; a 2-terminal wire with a molecular resonant 
tunneling diode 32; 2-terminal wires with an incorporated quantum well 34; 3- terminal wires 
36; 3-terminal wires 38 with molecular resonant tunneling diodes; 4-terminal wires with 
15 molecular resonant tunneling diodes 40 (with-diode-version only shown), molecular 
controllers 42 that can be modulated via the external peripheral fields, massive interconnect 
stations based on single gold or silver nanoparticles 44, DRAM components 46 composed of 
molecular controller/nanoparticle or fullerene hybrids in an inert atmosphere, preferably aigon 
or nitrogen. Moreover, the present molecular computer, once formed, can be further modified 
20 by new interconnect routes via electrochemically-induced crosslinking of the nanoparticles or 
by "burning out" components through large induced fields, analogous to the operation of a 
field programmable gate array (FPGA). Adding, deleting and changing the bridges from input 
to output pins alters the selection of relationships between the input and output pins. 

Initially the system is in a blank state, with random interconnects yielding generally 
25 meaningless output for a given input. The system is then trained, that is, taught new logic 
functions by forcing the correct output n for a given input m (i.e., an n(m) function) by 
varying the inputs 1 until stability is achieved. The goal of self-reconfigurability implies that 
one sacrifices control over detailed reconfiguring: it is not necessary to know the exact 
interconnect structure in order to give the correct relationship between input and output. The 
30 system then functions as a molecular computer. Furthermore, it does not necessarily have to 
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operate in a binary mode. Use of hexadecimal or analog modes, for example, would vastly 
increase the information storage density at the expense of increased programming demands. 

During the assembly, the computer will be connected using the I/O leads. After the 
assembly process, the computer will be interfaced via the metallic input and output pins of the 
5 molecular computer via normal lithographic wiring. For each logical component, an I/O 
determination routine will be executed up to the point that a usable truth table is obtained for 
a desired operation. To decrease the number of individual single bit I/O combinations to be 
tested, I/O tests can be bundled, thereby decreasing the number of I/O testing combinations . 
while increasing the chances of overcoming single fault locations. To determine single fault 
10 locations, subcircuits can be tested in aggregate. 

More complex, analog responses can be measured as well (a hybrid on-chip 
multiplexer can be incorporated as necessary) to allow approximation of the numerical 
parameters associated with the signal thresholds and response curves and to develop and refine 
software models of the performance of working moleware. This approach allows tuning of 
15 the manufacture of the moleware to increase yields of working components. 

The programming of the molecular computer takes into account its architecture, and 
in particular (i) its very large number of components, (ii) its variable assembly process, and 
(iii) the incorporation of some components that are only partially functional. 

The large number of components dictates that a modular programming approach 
20 wherein key functional modules are determined and separated for execution by the molecular 
computer. These modules are trained and tested. The variable assembly of the molecular 
computer permits a corresponding flexibility in programming. For example, if one wanted 
relatively more memory capability, more semiconductor nanoparticle/controller (DRAM) 
elements would be attached during the assembly process. Second, as with the FPGA, specific 
25 elements could be hard-wired into the final system by a burning out approach, just as is 
currently done with macroscopic field programmable arrays. Thirdly, new interconnect routes 
via electrochemically induced crosslinking of the nanoparticles can be achieved by adding, for 
example, pyrrole to form new wire interconnects between the particles by application of a 
potential for polypyrrole growth. 
30 While the system will also be software programmable once a truth table pattern has 

been defined, incorporation of components wherein a portion of them are only partially 
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functional requires that the programming of the present molecular computer to provide 
dynamic faults. The software needs the capability to detect faulty components on an on-going 
basis, and the programming will need to allow faulty components to be bypassed by other 
components. There is a large body of literature in the error-resilient programming techniques 
5 that may be employed. To facilitate the efficient detection and repair of faults, our software 
architecture for fault resiliency may be designed with a hierarchical structure and employ 
methods for re-assigning computations to reliable components. 

The present molecular computer overcomes shortcomings of VLSI computers by pre- 
fabricating moleware, which is defined as molecular components such as RTDs and DRAMs, 
10 as well as molecular level interconnects based on molecular wires and junctions. 
Prefabrication is achieved by intelligent self-assembly strategies. In this context, "intelligent" 
means using pre-formed molecular components and knowing the order of additions for each 
component — typically, molecular wires first, then nanoparticles, then more molecular wires 
including wires with barriers. In that way, if one desired, a similar molecular computer can 
15 be constructed using the same sequence of moleware addition. However, just as with 
biological brains, no two molecular computers would be identical. 

Figs. 2A, 2B and 3 illustrate the containment and pin array. The container 50 for the 
molecular computer may either contain or be directly fabricated from 2D rectilinear I/O grids 
52 on a substrate and be approximately 1 centimeter on a side. Initially, there would be ports 
20 54 for injection of organic solutions of moleware. There would preferably be 1 000 pins 60 on 
each face for input and output. Any combination of the pins could be used for inputs 12 and 
outputs 14. The I/O routes could be interchanged as designed for a specific function. The 
interior portions 62 of the pins would be the binding sites to the initial moleware components 
in the intelligent self-assembly process, or be multi-branched electrodes (trees) that extend into 
25 the molecular computer. To provide more states, a multi-branched 3D electrode could have 
alternating and possibly aperiodic regions, that may be exposed, to form complex nucleation 
topologies. The initial port 54 could be sealed after assembly is complete. Various electrode 
issues (metal, spacing, etc.) are within the capabilities of those with ordinary skill in the art 
without undue experimentation and can be determined on a microfabricated 2D chip with the 
30 candidate molecular computer moleware. 
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Along the periphery or through the container, field gradients can be introduced to 
control the DRAM segments. These are applied by macroscopic leads running through the 
interior of the box when higher gradients are to be used. Initially these are nested, insulated 
multi-branched 3D electrodes that provide the scaffolding for the moleware. 

5 Figs. 4 through 11 illustrate alligator clips, molecular wires and their attachment to 

nanoparticles and other moleware used with the present invention. One type of molecular wire 
is illustrated in Fig. 4, namely, a wire 70 with an isocyanate terminus that will interact with 
the empty orbital on vanadium 72 and the filled surface bands. Fig. 5 illustrates two other 
metal complexes, a tetrahedral complex 74 where "M" can be Vanadium, Niobium, or 
10 Tantalum, and a square pyramidal complex 76 where "M" can be Molybdenum or Tungsten, 
for use as a terminus. Fig. 6 illustrates a molecular wire 80 with "alligator clips" 82 (where 
"Z" can be, for example, SH, SiCl 3 , NV(SH) 3 ) on each end with solubilizing groups 84 (where 
"R" can be, for example, C 12 H 25 ) attached along the length of wire 80. "Alligator clip" means 
a device - here a molecule - that attaches one component to another, in an analogy to 

1 5 macroscopic spring biased "alligator" clips used in more traditional electronics to attach wires 
to terminals. 

The molecular wires are constructed from oligo(phenylene ethynylene)s bearing thiol 
termini for alligator clips or more conductive planar oligomer segments, or even carbon or 
related nanotube structures. The wires can be varied in length, functionality, number of 
20 termini, etc. Ab initio calculations and one-dimensional simulations of these systems can be 
performed to determine their characteristics as molecular wires and termini. 

The molecules that form the control moleware (Fig. 1 B) are those that permit more or 
less current to flow through them, as modulated by a third electrode field, that will be 
produced by the field arrays in specific regions as needed. Gold, platinum and silver, perhaps 
25 in combination, provide excellent stations for massive interconnection of the assembly 
moleware, thereby making the contents more conductive and providing for network-like 
operation. Self-assembly techniques using Afunctional molecular wires can be used to cap 
the particles with active surface chemical groups that will electrically connect the particles to 
the device electrodes and to "bare" metal particles of selected sizes, thus forming 
30 controlled-geometry, conductive networks. The use of controller molecules in the capping 
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step would add a switching capability to the network lines when external fields are applied. 

Using semiconductor nanoparticles such as CdS and CdSe or even fiillerenes, and 
decorating their surfaces with the controller molecules (Fig. 8) would permit the nanoparticles 
5 or fiillerenes to act as switchable capacitors: charging in the presence of an applied field and 
retaining the charge once the field is diminished. 

Insulating oxides such as A1 2 0 3 , H0 2 , and Si0 2 , will be surface capped with chemical 
groups for the selective interconnection to conductive metal particles (Fig. 9). These oxide 
particles thus act as high impedance resistors in the circuit. Control of the fractions of 
1 0 insulating particles in the self-assembling mixture will thus allow control of the total number 
of circuit connections up to the ultimate limit of the percolation threshold. Approaching this 
limit will impart exceedingly high sensitivity to the current-voltage characteristics across the 
individual I/O ports in the device. 

All of the moleware: wires, junctions, DRAMs, etc., are synthesized prior to the 
1 5 intelligent self-assembly Ayithin the container, as seen in Fig. 1 2*. One only needs to add them 
and permit the assembly as needed. If more memory elements are desired, for example, one 
simply adds more DRAMs. By varying the chemical nature of the surfaces of each type of 
nanoparticle through molecular capping techniques, the relative interconnection affinities of 
the molecular and nanoparticle components can be controlled thus providing a rational means 
20 to tune the final structure and functional states of the molecular computer. This strategy, 
together with the control of the relative amounts of components, their addition sequence and 
intermittent real-time feedback driven pulsing of the device I/O ports, form the key to the 
overall intelligent self-assembly approach. It will be clear that the order of addition of each 
species of moleware, the amount, the delay time before a second and a third species is added, 
25 will affect the development of the nature of the structure bridging the inputs and outputs. 
Although the bridges so formed will vary, the bulk of them will reflect the rationality of the 
sequence and a greater percentage will be usable than if all the moleware species were added 
at the same time. Field effect structures (molecules that change their orbital structures based 
on electric fields) could also be considered as moleware components. 
30 The alligator clips for the moleware of the present microcomputer may be fabricated 

using metallic connection atoms in the series sulfur to selenium to tellurium, and others such 
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as isonitrile, carboxylate (for adhesion to the native oxides of Titanium and Aluminum) and 
SiCl 3 (for adhesion to the native oxide on silicon). Alternatively, organo-transition metal 
species can be made using V, Nb, Ta, Mo, and W, which have an empty low-lying orbital 
projected toward the metallic surface which should respond as a gradient for the electron 

5 transport. Isocyanides are also useful in that they have a two-fold decrease in barrier height 
when attached to palladium with respect to thiols on gold. Thiols themselves bind well to Au, 
Ag, GaAs, Ptlr and numerous other metallic surfaces. This would project the transition metal 
atom's empty d z 2 orbital directly into the metal surface for interaction with the filled metal 
band (Fig. 4). This is a unique approach to make a system that is analogous to a gradient of 

1 0 charge in a solid state system wherein the gradient is used to solve the impedance mismatch 
problems. 

As seen in Fig. 6, molecules will be functionalized with alligator clips in order to make 
direct chemical contacts with the I/O electrodes and nanocomponents, viz., nanoparticles, to 
which the molecules will be attached in functional chains. The chemical nature of the alligator 

15 clip groups will be optimized for chemical bonding selectivity to desired surfaces, bond 
stability and favorable electrical junction properties. The groups will be chosen from a set of 
precursors which will provide the following bonding units as needed: RS-, RSe-, RTe-, RNC-, 
RC0 2 -, where R = the molecules to which the group is attached. This set allows good 
flexibility in terms of the possible groups but other groups are possible also such as RP0 3 H 2 , 

20 RSiO x , and RNH 2 , depending on the type of electrode or nanoparticle surface desired. The 
variety of groups goes well beyond the typical S-based ones previously used since these newer 
varieties includes attachments to insulator surfaces, in addition to the typical case of just Au 
electrodes used in the past. This extension requires no more than state of the art surface 
chemistry. 

25 Molecular wires can be fashioned of oligomers, fully soluble, of precise length and 

with alligator clip connection points. Suitable materials for molecular wires include carbon 
nanotubes, which are highly conductive, planar polyphenylenes, polypyridines, polypyrazines 
and polythiophenes. 

Fig. 7 illustrates a controller molecule 90 connecting two nanoparticles 92, illustrated 
30 in its two states ("on" and "off'). Controller molecules 90 are switched by an electric field. 
A donor/acceptor component on adjacent rings in an applied field stabilizes the zwitterionic 
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form making it more planar. In this manner, the starting orientation to the applied field is 
irrelevant so no polling of the system during formation is required. This molecule would be 
analogous to a bi-poiar switch in the "ofT position, meaning negligible current would pass 
though the molecular chain. Once the field is applied, however, the central molecular element 
5 would switch to a more planar state with a smaller bandgap, and hence a more conducive 
configuration to enable current to flow. 

The terms planar and perpendicular are not intended in the literal sense, only that the 
initial structure has a higher degree of twist than the latter structure. Hence electron transport 
will be more facile in the second structure. This is precisely what is needed for an electronic 
1 0 system. Note that DRAM systems generally are refreshed every 1 0" 5 seconds, therefore, even 
slight electronic retardations are sufficient. The initial biphenylnitroamine moiety would 
reside in a less planar state than the zwitterionic structure. However, a perpendicular electric 
field component would stabilize the zwitterionic state, thereby making that form a greater 
contributor to the resonance forms. Once in that form, electronic passage should be more 
15 facile. Even if there were multiple molecules attached to the nanoparticle, as long as one 
became more planar in the applied field, electrons could be trapped on the nanoparticle and 
the field then diminished for information storage. 

Gold, platinum and silver nanoparticles 100 provide excellent stations for massive 
interconnection of the assembly moleware, thereby making the contents more conductive and 
20 providing for network-like operation. Self-assembly techniques using bifunctional molecular 
wires 102, best illustrated in Fig. 8, can be used to cap the nanoparticle 100 with active surface 
chemical groups 1 04 that will electrically connect the nanoparticles to the device's electrodes 
106 and to "bare" metal particles of selected sizes added to the interior of the containment, 
thus forming controlled geometry conducting networks. The use of controller molecules in 
25 the capping step would add a switching capability to the network lines when external fields 
are applied. This requires self-assembling, nanometer-scale components into strings or 
networks in which the various components are interconnected in various ways. The basic 
components consist of multiple alligator clip molecules, including both wires and controllers, 
and nanoparticles made from metals, semiconductors and insulators. The simplest structure 
30 is a nanoparticle, such as would be formed from a semiconductor, attached to an electrode by 
a bifunctional molecular wire. When a field is applied between the base electrode and a 
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nearby electrode, this structure will act as a capacitor as charge is pulled into (or drawn out of) 
the semiconductor particle. A more complicated linear string would contain a field activated 
controller molecule and a semiconductor nanoparticle. These components could impart 
sophisticated properties to the string if appropriately connected between electrodes and placed 
5 so that local fields could be varied. Such strings, or 3-dimensional networks, will be formed 
in-situ so as to have a fraction attached to the I/O electrodes. 

Nanoparticles 100 are synthesized in different sizes, from -1.5 nm to -500 run, as 
required. The surfaces will be activated, as seen in Fig. 9, by various chemical connecting 
molecules 1 08 to facilitate the interconnections. The final hybrid assemblies will be made by 
10 simply mixing activated components in non-aqueous solvents. The metal nanoparticles 
primarily are made of gold and these are synthesized at controlled sizes using established 
methods. Other similar conductive metals such as Pt, Pd, and Ag can also be used. 
Attachment of molecules such as RS-, RSe-, RTe-, and RNC- uses current attachment 
chemistry techniques, where R is connecting molecule 1 08 with variations chosen to optimize 
15 surface bonding and junction impedances. For Pt, the same groups can be used. The 
nanoparticles 1 00 are most easily made in an aqueous solution. However, for assembling the 
hybrid structures, non-aqueous conditions must be used in order to maximize molecular 
solubilities. This is done by pre-functionalizing the nanoparticle surface with short, 
solubilizing alkanethiolate chains (~C 4 rV) or other coordination groups to form capped 
20 structures. These moieties will be transferred to appropriate organic solvents such as THF in 
which the molecular wires or switches will be attached by insertion into the host alkanethiolate 
surface matrix on the nanoparticle. This strategy will also serve to orient the inserted molecule 
in an outward direction from the surface. Electroactive molecules can be placed onto the 
surface of Au particles in the 1-2 nm size range and thus give those particles electrochemical 
25 effects. 

Referring now to Fig. 10, using semiconductor nanoparticles such as CdS and CdSe 
or fullerenes (C 60 ) 1 1 2 and decorating their surfaces with the controller molecules 1 1 0, would 
permit the nanoparticles and fullerenes to act as switchable capacitors: charging in the 
presence of an applied field and retaining the charge once the field is diminished. C 60 can be 
30 electrochemically reversibly charged with up to six electrons. The first four electrons are 
accepted with great facility (-0.98, -1.37, -1.87, and -2.37 volts vs. Fc/Fc+). Therefore, this 
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could serve as an excellent molecular capacitor The semiconductor particles consist primarily 
of metal chalcogenides, such as CdSe, CdTe, ZnSe, and ZnTe. The Cd-based nanoparticles 
are well-known and can be prepared with controlled sizes. Their synthesis and surface capping 
follows well-known established procedures. The surface functionalization of the 

5 chalcogenides involves primarily RS-, RSe-, and RTe- attachment groups. The electronic 
band structures of the capped nanoparticles and hybrid assemblies are probed using X-ray 
photoemission and optical spectroscopy. These particles can be attached to metal surfaces 
using self-assembly chemistry. For particles and hybrids assembled at surface, photoemission 
and spectroscopic ellipsometry are used. The physical structures can be examined by surface 

1 0 probes including STM and AFM and electron microscopes including TEM and high resolution 
SEM. 

Insulating oxides, such as A1 2 0 3 , Ti0 2 , and Si0 2 , are surface-capped with chemical 
groups for selective interconnection to conductive metal particles. These oxide particles act 
as high impedance resistors in the circuit. Control of the fractions of insulating particles in the 

1 5 self-assembling mixture will thus allow control of the total number of circuit connections up 
to the ultimate limit of the percolation threshold. Approaching this limit will impart 
exceedingly high sensitivity to the current-voltage characteristics across the individual I/O 
terminals in the device. The insulator nanoparticles are made using standard methods. 
Typically, Ti0 2 and A1 2 0 3 are used. The latter is desirable since hydrated Al 2 0 3 surfaces can 

20 be very efficiently and selectively bonded and functionalized using organic acids such as 
RC0 2 H and RP0 3 H 2 . The phosphonic acids are useful since they form a "tripod" bonding to 
the surface which orients the adjacent part of the adsorbate perpendicular to the surface (see 
Fig. 11). Si0 2 nanoparticles also make excellent insulator components but the best surface 
functionalization chemistry involves SiO x bonding which forms polymeric networks and is 

25 difficult to control. Other possible nanoparticles include Sn0 2 . Functionalization chemistry 
is available, for example, RS- chemistry developed for indium tin oxide electrodes transfers 
to Sn0 2 . 

Modular pre-assembly of the moleware, illustrated in Fig. 12, is done prior to the 
intelligent self-assembly within the container. All components are added as needed and the 
30 assembly permitted. If more memory is desired, more DRAMs are added, for example. By 
varying the chemical nature of the surfaces of each type of component nanoparticle, the 
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relative interconnection affinities of the molecular and nanoparticle components can be 
controlled, thus providing a rational means to tune the final structural and functional states of 
the present modular computer. This strategy, together with the control of relative amounts of 
components, their ad J.tion sequence and intermittent real-time feedback-driven pulsing of the 
5 device I/O ports, forms the key to the overall intelligent self-assembly approach. 

For example, there are a variety of strategies for assembling the functional hybrid 
strings and networks The general approach is to cap each nanoparticle 120 by a layer of 
bifunctional molecules 1 22 (where "A" is -SH). In the cases of metals and semiconductors • 
where molecular wires 124 will be used, wires 124 must be oriented away from the 
10 nanoparticle's surface by insertion into a pre-assembled host monolayer of a short chain 
molecule. For insulators, the bifunctional molecules 122 can be insulating so that the 
precapping step is not necessary. The attachment groups A, C, F for a gold nanoparticle 120 
will typically be A = -SX (X = H, Ac, etc.) or -NC for Au, C = SX (X = H, Ac, etc.) for CdSe, 
etc. and F= be -C0 2 H or P0 3 H for Al 2 0 3 - The surface termination groups will typically be 
15 B = A, D = C and G = A or C. A variety of starting nanoparticles 120 of different types, sizes 
and surface termination chemistry can be made. Varied relative amounts of desired types of 
the starting nanoparticles 120, including simple metal particles (e.g., Au with a "bare" 
surface), will be added, together and in sequences as desired, into a solvent containing a gold 
electrode surface functionalized with a molecular wire 1 24 terminated by B. Choosing surface 
20 terminations that attach to nanoparticle 120 will cause the mixture to interconnect in a 
statistical fashion both to itself in solution and to the Au electrode. These kinds of surface 
terminations will cause a network 1 3 6 to grow outward from the surface 1 40 . A large number 
of possible paths will be produced which contain interconnections of metals 128, 
semiconductors 1 30 and insulators 132, thus generating a M . 
25 network 136. Given the close proximity of neighboring base electrodes, network 1 36 will be 
established across the electrode gap forming a circuit connection, as illustrated in Fig. 12.' 
Given the wide choices in the starting nanoparticle materials, their sizes, chemical 
terminations, the mixture compositions and mixing sequences, a huge variety of possibilities 
exists for controlling the statistical character of the network circuits. The next extensions of 
30 tWsstrategywillincludetheadditionofcontrollermoleculestoimpartpotentialfield-activated 

switching properties to the networks. The controller molecules can be added both by including 
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them in the nanoparticle caps and by adding the molecules to the mixing solutions so that they 
become incorporated in the growing network. The structures of the networks assembled at 
single metal electrodes will be probed by elemental analysis (e.g., wet chemical techniques for 
the w, x, y, z stoichiometric factors), high resolution SEM, AFM and TEM (for cases of 
5 networks grown from surfaces such as SiO or C on TEM grids), and NMR. 

Precisely defined molecular architectures including molecular wires 150, wires with 
tunnel barriers 152, wires with quantum wells 1 54, three terminal junctions 156, three terminal 
systems 158 that may act as switches or transistor, and four terminal molecules 160 with 
strategically-placed tunnel barriers that may act as logic devices are illustrated in Fig. 13. 
10 These are embodiments of the more general types of moleware illustrated in Fig. IB, with 
molecular wire 30 corresponding to molecular wire 150, wire with tunnel barriers 32 
corresponding to wire 152, wire with quantum well 34 corresponding to wire 154, three 
terminal junction 36 corresponding to junction 156, three terminal switch 38 corresponding 
to switch 158, and four terminal molecule corresponding to molecule 160. Note that "SAc" 
15 indicates a "protected aligator clip", which has an acetyl group that is removed during self- 
assembly permitting sulfur to form contacts with metal surfaces. The acetyl group is removed 
by adding a base such as ammonium hydroxide, although it can be removed by the gold 
surface itself, albeit more slowly. 

All of the syntheses have been developed in a convergent fashion in solution or using 
20 synthetic methods on a polymer support to streamline the synthetic protocols. Using 
compounds similar to the wire with two tunnel barriers, we observed negative differential 
resistance as expected from a resonance tunneling diode. Therefore, precise molecular 
architecture has been used to build device-like properties into nanoscale systems. Molecules 
such as those shown can be used in the present molecular computer array. 
25 Described below is a moleware preparation, deposition on a two-dimensional chip 

platform, and subsequent test of the I/O leads. 

Moleware preparation: A solution of octadecyl-terminated single-walled carbon 
nanotubes (1) was prepared by a slight modification of a procedure by Chen, J. et al. (Chen, 
J.; Hamon, M. A.; Hu, H.; Chen, Y.; Rao, A.; Ecklund, P. C; Haddon, R. C. Science 1998, 
30 282, 95-98). To 100 mg of crude single-walled carbon nanotubes (SWNTs, obtained from 
Tubes@Rice) was added concentrated sulfuric acid/nitric acid (3:1 v/v, 10 mL). The mixture 
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was sonicated for 4 h (Cole-Parmer, model B3-R) followed by filtration (0.2 micron PTFE) 
and washing with methanol. To the resulting oxidized SWNTs (14.5 mg) was added thionyl 
chloride (25 mL, 343 mmol) and dimethylformamide (1 mL). The mixture was sonicated for 
0.5 h and heated to 70 C for 24 h. After cooling and centrifugation (Fisher Scientific, 
5 Marathon 22 K. 4200 PRM) for 2 min, the solid was collected by filtration and washed with 
freshly distilled Tl IF and then dried under vacuum (6 mm of Hg) at room temperature. A 
mixture of the resulting SWNTs (13 mg) and octadecylamine (2 g, 7.4 mmol) was heated to 
1(K) ( tor 4 days. After cooling to room temperature, the solid was washed with ethanol, 
sonicated vMth diethyl ether/hexane (1:1, v/v), collected by centrifugation and filtration and 
10 dried under vacuum (6 mm of Hg) at room temperature for 1 h. Some exogenous 
octadecylamine remained with 1. The resulting 1 could be dissolve in chloroform, 
tetrahydrofuran. or methylene chloride. 

Molcware Assembly on Chip: An array of 60 gold dot electrodes, as illustrated in Fig. 
14, ( 10 micron diameter per dot, 100 micron pitch distance between dots) had one fourth of 
1 5 the dots exposed ( 1 5 dots), the remainder of the dots were coated with titanium dioxide, and 
hence inactive. Each of the electrode dots was affixed to a bonding pad via a titanium 
dioxide-coated gold wire. A solution of 1 in chloroform (0.01 w/w ) was prepared. A 200-mg 
portion of the solution of 1 in chloroform was placed over the entire chip. After air drying, 
the chip was placed under vacuum (6 mm of Hg) at room temperature for 15 min. The 
20 deposition was somewhat ragged and the film cracked. 
Electrical Measurements on Chip. 

The resistance between any two adjacent electrodes was generally below 20 Kohms, typically 
1 2 Kohms, as measured by a multimeter. One electrodes pair had a resistance of -1 00 Kohms 
between them. 

25 Zero-bias conductivities of -10-100 micro Siemens were recorded. 

I(V) traces (current- voltage) show nonlinearity around zero, and high field saturation. The low 
bias nonlinearity may be due to the 1 -1 junctions, although further characterization would be 
necessary. The high field noise is higher than at the low field. 

Using third terminal current injection, the conductivity (between two electrodes) could be 
30 modified (remotely, by the third electrode) downward in most cases. This is rather reminiscent 
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of degradation and breakdown. However, occasionally, an increase in conductivity (-2 fold) 
was noted, with some hysteretic behavior, reminiscent of electrical gain. 

It will be apparent to those skilled in the art of nanotechnology and computer 
architecture that many substitutions and modifications can be made to the preferred 
5 embodiments described above without departing from the spirit and scope of the present 
invention, defined by the following claims. 
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WHAT IS CLAIMED IS: 

1 . A molecular computer, comprising: 
a container formed of a lattice having 

a multiplicity of input pins carried by said container, 
5 a multiplicity of output pins carried by said container; and 

moleware contained within said container. 

2. The molecular computer as recited in claim 1, wherein said moleware is selected 
from the group consisting of metal particles for interconnecting said moleware, molecular 
alligator clip-bearing 2-, 3-, and 4-terminal molecular wires, carbon nanotubes, molecular 

1 0 resonant tunneling diodes, molecular switches, molecular controllers, molecular DRAM and 
SRAM components selected from the group consisting of molecular controller/nanoparticles 
and fullerene hybrids, and combinations thereof. 

3. A molecular computer made by a process comprising the steps of: 
attaching plural input and output pins to a containment; and 

15 injecting moleware into said containment; 

allowing said moleware to form bridges between said input and said output pins; 
applying voltages to input pins; 
measuring voltages at said output pins; and 

identifying the relationships between input and output pins when voltages are applied 
20 to said input pins until a truth table is constituted for said computer. 

4. The molecular computer as recited in claim 3, wherein said moleware is selected 
from the group consisting of metal particles for interconnecting said moleware, molecular 
alligator clip-bearing 2-, 3-, and 4-terminal molecular wires, molecular resonant tunneling 
diodes, carbon nanotubes, molecular switches, molecular controllers, molecular DRAM and 

25 SRAM components composed of molecular controllers or fullerene hybrids, and combinations 
thereof. 

5. The molecular computer as recited in claim 3, wherein said applying step is done 
by applying said voltage to a bundle of said input pins and said measuring step is done by 
measuring voltages at a bundle of said output pins. 
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6. The molecular computer as recited in claim 3, further comprising the step of 
applying field gradients across said containment to modify said bridges formed by said 
moleware between said input and said output pins. 

7. The molecular computer as recited in claim 3, further comprising the step of 
5 electrochemically inducing cross linking of moleware to modify bridges formed by said 

moleware between said input and said output pins. 

8. The molecular computer as recited in claim 3, further comprising the step of 
eliminating a portion of said bridges formed by said moleware between said input and said 
output pins. 

10 9. The molecular computer as recited in claim 3 , wherein said moleware components 

are less than 1000 nanometers in diameter. 

1 0. The molecular computer as recited in claim 4, wherein said injecting step is done 
by injecting each type of moleware separately and at intervals. 

11. The molecular computer as recited in claim 3, further comprising the step of 
15 installing a support matrix inside said containment prior to injecting said moleware. 

12. The molecular computer as recited in claim 3, further comprising the step of 
varying said voltages applied to said input pins until a desired output at said output pins is 
achieved. 

1 3 . The molecular computer as recited in claim 3 , wherein a portion of said moleware 
20 includes semiconductor particles coated with molecular control elements adapted to perform 

memory functions for said molecular computer. 

14. The molecular computer as recited in claim 3 , wherein said identifying step further 
comprises the steps of: 

connecting a computer to said input pins and said output pins; and 
25 using said computer for identifying said relationships. 

15. The molecular computer as recited in claim 3, further comprising the step of 
programming said molecular computer using error resilient software. 

16. The molecular computer as recited in claim 3, further comprising the step of 
synthesizing said moleware in solution before injecting said moleware. 

30 17. The molecular computer as recited in claim 4, wherein said molecular wires are 

constructed from materials selected from the group of oligo(phenylene ethynylene)s. 
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18. The molecular computer as recited in claim 17, wherein said molecular wires have 
termini made of a material selected from thiol, planar oligomer segments or carbon nanotubes 
or bundles thereof. 

19. The molecular computer as recited in claim 17, wherein said molecular wires are 
5 selected from the group consisting of carbon nanotubes, planar polypheny lenes, polypyridines, 

polypyrazines and polythiophenes. 

20. The molecular computer as recited in claim 4, wherein said particles are made of 
a material selected from gold, silver, palladium, platinum and alloys thereof. 

21. The molecular computer as recited in claim 3, wherein said solution is a 

1 0 nonaqueous solution. 

22. The molecular computer as recited in claim 20, wherein said particles are capped 

with Afunctional molecular wires. 

23 . The molecular computer as recited in claim 4, wherein said molecular switches are 
selected from the group consisting of semiconductor particles having controller molecules on 

1 5 their surfaces and fullerenes. 

24. The molecular computer as recited in claim 23, wherein said semiconductor 
particles are selected from the group consisting of CdS and CdSe. 

25. The molecular computer as recited in claim 4, wherein said molecular resistors are 
made of insulating oxides adapted for connection to metal particles. 

20 26. The molecular computer as recited in claim 25, wherein said insulating oxides are 

selected from the group consisting of A1 2 0 3 , Ti0 2 , and Si0 2 . 

27. The molecular computer as recited in claim 4, wherein said alligator clips are made 
of a transition metal attached to a metallic surface. 

28. The molecular computer as recited in claim 4, wherein said molecular controllers 
25 each have a zwitterionic form that stabilizes in the presence of an applied electromagnetic 

field. 

29. The molecular computer as recited in claim 28, wherein said molecular computer 
is biphenylnitroamine. 

30. The molecular computer as recited in claim 3, wherein said solution is an organic 

30 solvent. 
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31. The method as recited in claim 3, further comprising the step of adapting said 
moleware to increase interconnection affinities of said moleware to each other. 

32. The method as recited in claim 31, wherein adapting step is selected from the 
group consisting of capping, functionalizing, activating and combinations thereof. 

5 33 . A method of transferring data from an input to an output, said method comprising: 

establishing a molecular bridge composed of molecules between an input and an output, said 
molecules including a first molecule connected to said input; and applying a voltage to said 
input sufficient to modify the molecular electrostatic potential of a first molecule. 

34. The method as recited in claim 33, further comprising the step of adapting said 
10 molecules to increase interconnection affinities of said molecules to each other. 

35. The method as recited in claim 34, wherein adapting step is selected from the 
group consisting of capping, functionalizing, activating and combinations thereof. 
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[571 ABSTRACT 

Neural net with spatially distributed functionalities. An 
information processing system comprises a neural net with 
fully distributed neuron and synapse functionalities in a 
spatially inhomogeneous medium to propagate a response 
field from an input to an output. The response field is a 
reaction of the medium to a plurality of input signals and 
depends non-linearly on the input signals. The response field 
is also determined by the inhomogeneities. The value of the 
field at one or more particular locations is indicative of one 
or more output signals of the neural net. 

9 Claims, 5 Drawing Sheets 
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NEURAL NETWORK USING 
INHOMOGENEITIES IN A ME DIUM AS 
NEURONS AND TRANSMITTING INPUT 
SIGNALS IN AN UNCH A NNELLED WAVE 
PATTERN THRO! Gl! THE MEDIUM 

This is a division of ar*f4H Sci. No. 08/201.609. 
filed on Feb. 25, 1994. 

FIELD OF THL INVf JsTION 

The invention relates to an inf ormation processing system 
with a neural net functionally composed of neurons inter- 
connected by synapses. The network h-u an input means to 
receive a plurality of input signals, an output means to 
provide at least one output signal, and an arrangement 
between the input means and the output means to implement 
a neural transformation of the plurality of input signals for 
generating the output signal. 

BACKGROUND ART 

Over the last decade, neural networks have attracted an 
ever increasing interest as signal processors. Such proces- 
sors essential characteristics reside in the non-linear map- 
ping of input signals onto output signals using spatially 
distributed elements and massively parallel information pro- 
cessing in a densely interconnected structure. Such a pro- 
cessor is a robust and fault-tolerant processing device. 
Furthermore, neural networks can be programmed by means 
of training on the basis of examples rather than by means of 
prescribing algorithmic instructions such as in the field of 
conventional microprocessors. Training can be accom- 
plished with or without a supervisor, the latter version being 
called "self-learning**. Neural networks are expected to play 
an important role, especially in the fields of associative 
memories, classifiers, pattern recognition and optimization 
problems. For a general introduction, see: 44 An Introd uction 
to Computing with Neural Nets**, R. P. Lippmann, IEEE 
ASSP Magazine, April 1987, pp. 4-22. 

Although some of the mathematical algorithms created 
for neural network control or neural network simulation 
appear to be useful in seeking software solutions to particu- 
lar problems, the real benefit of the neural network approach 
is believed to be obtainable only by way of dedicated 
hardware. A variety of electronic and optical hardware 
implementations of neural networks have seen the light over 
the last decade. For example, the Laboratoires d* 
Electronique de Philips has developed the first commercially 
electronic, fully digitally operating, trainable neural chip for 
modular neural network architectures, see U.S. Pat. No. 
4,994,982. An electronic implementation of an analog neural 
net is known from, for instance, U.S. Pat. No. 4,866,645. 
Optical neural nets are dealt with in: "Optical Neural 
Computers**. Y. S. Abu-Mostafa and D. Psaltis, Scientific 
American 256, March 1987, pp. 66-73. 

Often, spatially tight designs are required to realize a 
sufficiently large number of the neurons and synapses in a 
confined space. A trainable neural net requires additional 
circuitry to individually and accurately modify the weights 
in the net's learning phase, necessarily leading to an increase 
of the system's size and complexity. Since the processing 
capability of a neural net increases with larger numbers of 
neurons and interconnections, nowadays efforts in neural net 
technology find a major target in increasing the density of 
neurons and interconnections. As an example, a major 
problem encountered in the design of electronic embodi- 
ments is the limitation to the number of neurons or neuron 
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functionalities that can be implemented on a single chip. 
Typically, the maximum number of neurons or neuron 
functionalities that can be integrated into a chip using state 
of the art technology is well lower than one thousand. 

5 Furthermore, the complexity and the mount of additional 
components needed to implement the learning capability of 
a net containing such large numbers of neurons is expected 
to be at least proportionally higher. 

The examples mentioned above have in common that the 

to associated architectures primarily have a lumped character. 
That is, the various respective functional elements of the 
neural net which perform the basic computations, such as the 
neurons and the synapses, are implemented by physically 
distinct devices or circuits. These devices and circuits are 

15 dedicated to operations such as weight multiplication, sum- 
mation and applying a sigmoid function. 

One of the ways to reduce of the number of neurons or 
neuron layers, to simplify the interconnection scheme and to 
increase efficiency, is to employ high-order terms (squares, 

20 products, cubes, etc.) of the input signals supplied to the 
neural net These high-order terms then serve as the signals 
to be handled by the neurons. See, for instance. C. Lee Giles 
et at, "Learning. In variance and Generalization in High- 
Order Neural Nets**, Appl. Opt, Vol. 26. 1987. pp. 

25 4972-4978. The high-order dependencies are determined in 
advance and can be thought of as pre-processed input data, 
the preprocessing being based on some prior knowledge of 
the kind of problems that the neural net is meant to solve. 
For example, different classification problems to be handled 

30 by a neural net may require different forms of non-linear 
correlations between the input signals. 

OBJECT OF THE INVENTION 

35 In view of the limitations discussed above, it is therefore 
an object of the invention to provide an information pro- 
cessing system comprising a radically new neural net 
architecture, which permits integration of larger numbers of 
neuron functionalities and is highly technology- 

^ independent 

SUMMARY OF THE INVENTION 

To this end, the invention provides an information pro- 
cessing system having a neural net that is functionally 

45 comprised of neurons interconnected by synapses. The net 
has an input means to receive a plurality of input signals, an 
output means to provide at least one output signal, and an 
arrangement between the input means and the output means 
to implement a neural transformation of the plurality of 

50 input signals for generating the output signal. According to 
the invention, the arrangement comprises a physical medium 
operative to propagate a response field throughout the 
medium in response to the plurality of input signals, the 
response field being non-linearly dependent on at least one 

55 of the input signals. The medium has one or more spatially 
distributed inhomogeneities operative to affect a spatial 
dependence of the field. The medium is operative to produce 
the output signal upon coupling at least a first response, 
representative of the field occurring at a first location in the 

60 medium, to the output means. 

The invention is based on the insight that the energy level 
of the medium's ground state depends on the boundary 
conditions applied. Upon exciting the medium under respec- 
tive different boundary conditions will lead to the medium 

65 settling in respective different lowest states. In this way. the 
boundary conditions serve as an input signal and the asso- 
ciated lowest energy configuration serves as an output 



BNSDOCID: <US 5706404A1_I_> 



5.706,404 

3 4 

signal, whose non-linear relation to the input signal is with regard to at least position, size or strength. As men- 
determined by the specific boundary conditions applied. In tioned the inhomogeneities interact with the continuous held 
this manner, the mapping required for neural net operation in the medium Selectively modifying the inhomogeneities 
can be attained using fully and substantially continuously provides a learning feature to the neural net of the invention, 
distributed and collective physical properties of a spatially s ^ implementation of a neural net in the invention is a 
inhomogeneous medium The medium may be an amor- two-dimensional electronic transport layer composed of 
pbous or a structured material, and may include a solid, a distributed, non-linear conduction paths between input con- 
liquid, a gas. a plasma, etc. The relevant properties are md oatpal contacts. The transport layer can be imple- 
associated with, for example, electrical, magnetic, electro- mente d by use of sub-threshold conduction of semiconduc- 
dynamic or acoustic fields, or with phenomena involving the )0 ^ fidWfect devices or by use of conducting granular 
conversion from. e.g.. an electric field mto an acoustic field, layers of orgjmic „ superconducting material. In a 
ctc - . , , , . , , „• semiconductor embodiment, the inhomogeneities may be 
The non-linear mapping and the mutual signal correlation inversion layers and depletion layers brought 
are achieved in a spatially fully distributed and parallel ^ mea ns of a mechanism 
fashion without necessitating clearly defined locations for u ^ m J Mes me A ^ sucb a floating gate, the 
neuron functionalities and synapse functionalities. This inhomogeneities ^ ^ adapted . 

enhances the chaxacter.stic robustness proper to neurd nete ^ embodiment utilizes a non-linear optical system 

Cons«mc»tiy.mgherdensitieso^ 20 ^^^^f^^Tlt^t 

uTor^Sg *e non-linearities required in neural net nionic patterns m a material ^l^'^Z^ 
op^tioTtofittiie properties achievable from various mate- dent index of refraction when subjected to laser light 
rSTand devices. SinceaU materials exhibit in some way or It is noted mat prior art literature associates a Hopfield 

another a nonlinear behavior, the invention considerably 25 neural network with spin glass systems. Spin glass systems 
extends the field of suitable technologies to functionally assume macroscopic states based on the collective behavior 
realize a neural net of microscopic spins. Once excited, the spin glass traverses 

Essential aspects of the neural net's internal operation an extremely long sequence of collective spin states unul an 
mcluae SwSition^ ^ crossing. Iriribttton I. a „ equilibrium will be attained dependent on the imhal «ci- 
"gnal op^l^ d^ease or%everse ^signal's contri- 30 UUion. This may take hours or even days^See for mrtance, 
^onVL collecrive ^Jg*££^ ^co^oS 

^rou^nT Zlf^^^J^ Acad. Sci^SA. VoL ^^{£2? 
" substantially monotonic within the parameter range used. „ "Der ganz andere Cornpute^ Denken nach Mens Aen Art 
additional measure may be required toVbtain inhibition and W Kinzel et aL. Bud der Wissenschaft 1-19 88, PP-^- 
, . 3 Spin glass systems occur in materials such as Au(Fe) and 

signal crossing. . . of- . . Cu(Mn) alloys and Cdl-xMnxTe semi-magnetic 

In case the medium's sbmulus-response charactemucis semiconductors in electronic dipole glasses 
substantiaUy monotonic. dre arrangerr^nt cornpn^s encod- ^™JSS. dJS«I I glasses (compensated Si or 
ing means coupling the physical medium to thejxWX w ^ in superconductor junction arrays, 

means for producing the output ^ upon r^uaUy ccr- JJJ» ^ lo ^ relaM tion times, contact- 

relating the first response and a ^^^"^.J* 6 and lenrninTat such nanolcale levels are problems 

operation of the encoding may involve for * virtually impossH>le to solve, at least with today's technol- 

difference between a pan- of responses, a ratio of a^pecUve ^addition, full connectivity, which is assumed in the 

response and an aggregate ^^^'^^ * ^ system models, does not really happen in these 
a respective response brought about by a change of a terns due to the finite range of physical interac- 

particular one of the input signals. tfons J 

Input signals may have different types. For example, one 
input signal may be of a dc voltage or of the energy of a BRIEF DESCRIPTION OF THE DRAWING 

photon, another one may be a current or an ac voltage. 50 The invention is explained in detail hereinafter by way of 

The arrangement may be provided with a connection example and with reference to the accompanying drawing, 
means between at least a second location and a third location wherein: 

in the medium to enable an interaction between the response jq G 1 illustrates the architecture of a conventional lay- 

field at the second location and the response field at the third CTed ^ emd nct . 

location. Such an interconnection means permits to circuro- 55 9 example of the neural net of the invention 

of input signals. Therefore, beyond a given size of the 60 the enfcodime nt in HG. 2, 

systern in the invention, resolution and noise become irnpor- FIG. 5 shows the functional distribution of inhomogene- 

tant One way of compensating for these drawbacks is to use iocs in the layer of FIG. 2; . , . < 

more contacts to extract more responses that combined FIGS. 6 and 7 give background information to formulae 

produce the output signal(s). Another way is to provide a in the text relating to' the operation of the non-linear inho- 
few long-range interconnections. 65 mogeneous layer; 

Preferably, the arrangement coniprises a control means to FIGS. 8. 9, 10 and 11 illustrate a simple quantitauve 

selectively modify the spatially distributed inhomogeneities example of the operation of a neural net in the invention; 
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FIGS 12 13 14 15 and 16 give detailed examples of the 112 to ground. Although the inputs and outputs can also be 
layered structure in a neural net of the invention. purely capacitive. this example considers *««£ nse 

100 to a dc excitation through ohmic contacts 104 and lvt>- 
DETAILED DESCRIPTION OF THE Contacts 104 and 106 are shown to be arranged at the 

EMBODIMENTS 5 periphery of layer 102. although this does not have to be so 

. . ... „, .. .„ in nractical implementations. The embodiment of neural net 
Despite the large vanatxon m then: architectures, the basic J^^S to te a planar device in this example to be 
operation performed by neural nets is a non-Une^ mappmg * implementation. The type of vector 

of the input onto the output in _a parallel land, preferably, m ™ - ^cussed below emphasizes binary input vector 
an adaptive fashion. Below it is Ulustrated how an mhomo- W£« eontououTinput signal This is 

geneous physical substance with a „on-taear sUuuJus- ^Se^SpEj the analysis of the example! 
response characteristic can in principle be employed to uuut ^ 1 . * . * « . „ rtf 

recent a neural network. An electronic example of such a Assume that an input vector X" is l^cn^ asenes of 

net of the invention is studied thereafter. Note that the the binary conditions (open=*; close*=l) of switches 108. 
invention is essentially technology-independent and that the Superscript "m" differentiates vectors corresponding^ dif- 
Stes of the invention are not reacted to electronic * ferent sets of binary input signals. T^e assorted res^pse^ 
i^nbodiments i c - components of current vector I™, show non-linear 

emoooim correlations between the input vector components X m t and 

Prior Art the contents of network 100. The contents of network 100 is 

ii * u- uu. represented by the distribution pattern of inhomogeneities 

Neural networks are made of a collection of highly ^ ^ non^earities li4 serving as neural "weights". The 
interconnected simple processors which, in the most inter- fonn of response current T can be written as: 

esting version program themselves adaptrvely in order to s 

solve a given problem- What really makes neural networks ^ v (i) 

systems rich is their highly varied interconnection styles 

between the processors. These styles determine the archi- M where is the non-linear conductance tensor of the 
tecture of a neural net which can vary anywhere from a network, depending on the pattern m and on bias voltage V. 
layer-to-layer interconnected feedforward network to a fully Note the structure of formula (i) reflecting mat of Ohms' 
interconnected Hopfield network. Despite the large variation law. Written out in its indexed components, formula (i) 
in their architectures, the basic operation performed by equals: 
neural networks still is an adaptive non-linear mapping of M 

the input onto the output in a parallel fashion. This non- r r W tml a m /y\3Ti 

linear mapping is demonstrated in a simplified three layer The system UD(Jer study i s assumed not to show negative 
network shown in FIG. 1. differential resistance (NDR) properties for this moment. As 

FIG. 1 shows an example of a conventional architecture is dis CUSSe 4 below, if layer 102 has NDR, many of the 
of a neural net 10. Neural net 10 is comprised of a plurality 35 encoding techniques mentioned here get simplified, 
of successively interconnected neuron layers 12, 14 and 16 

between an input 18 and an output 20. Each interconnection Signal Diagrams 

(synapse), e.g., 22 weights the signal provided by a source ^ QQt %0 ^ me 

neuron, eg., 24 by a particular factor synaptic coefficient) currents F\ as a function of input bias 

and supplies the weighted signal to me input of a destination m £ vector events X™, can be schematic 

neuron, e.g.. 26 in the next layer. Destination neuron 26 JJ* v ana mpu mpo ^ 

sums the thus scaled contributions of all * <^_»" SoES on bias voltage V of current ^ produced at an 
and applies a non-linear function (e.g., a sigmoid function) JJJ^^ ^ ^ r ^ nsc to mput pattern 2T- As is 
to the resulting sum for generating its output signal that m j s a monltonic mnction oTV. FIG. 4 shows 

turn is supplied to a neuron, e.g.. 28 of the next successive 45 "f^Sre * of r on mc to tal number "n~ of 

layer via synapse 30. Note that the essential c>peration of J^dy-g* or c* k . $ moootonic 

neural net 10 is a runctionaUy duddW I and parallel J^™^ to T sum KW^«3PV i.e., of the 
non-lmear mapping of the mput onto the output total number of dosed ones of switches 108. Note that the 

Principle of Fully Distributed Embodiment _ schematic response of any of output contacts 106 as a 

F J _ .„ u . 50 function of 2T shown in FIG. 4. is similar to the response 

The invention provides a device, which will aclueve ^^ed from a functional MOS transistor which couples 
non-linear mapping like neural nets such as the one of FIG. scvcra i capacitive (gate) inputs to a single output current 
1, but replaces the lumped pans of a neural network by fully (sourcc _^dn) to achieve a neuron-MOSFET. See: "A Func- 
and substantially continuously, spatiaUy distributed rune- MQS Transistor Featuring Gate-Level Weighted Sum 

tionalities. 55 and Threshold Operations", T. Shibata et aL, IEEE Trans. 

FIG. 2 illustrates an example of a neural net 100 in the Electron Devices, vol. 39, 1992, pp. 1444-1455. 
invention. Neural net 100 includes a non-linear multi-port jf due to the monotonic output response of non-linear 
inhomogeneous electronic layer 102 and a plurahty of input ' ^ m we rc to be defined simply as: 

contacts 104 and a plurality of output contacts 106. Input *~ 

information to layer 102 is supplied through a set of N 60 cr^r-ia^** <" i > 

switches 108 connected to contacts 104. The binary (on or .... ~ ^ . # . 1A o QftH/rtr 

off) state of a particular switch "T among switches 108 is then closing an additional one of the switches 108 and/or 

denoted by X,!for i-1.2 N. The states X, determine increasing the bias level to V-hdV would always give rise to 

which ones of contacts 104 are connected to power supply a change of fixed polarity in the output signal O, that is. an 
110 that provides a bias voltage V. The raw output from layer 65 increase in above example. In other words, encoding me 
102 is assumed to be a set of response currents, I, for j=L2, output information according to (iii) does not provide inhibi- 
M which flow out of the device through small resistors tory behavior. If non-linear mapping, as in neural nets, is to 
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be achieved, inverse effects such as negative contributions or difference between the currents at the two output contacts, 

inhibition should be produced by some of the input signals With above formulation, it is easy to show that the output 

X"^. In addition, it should be shown thai electronic signal signal of the network for 2£ 3 =<1*1) * s: 
crossing between two opposite orm* coupled pairs of input 

and output contacts is possible to aewmpush signal corre- 5 ^ l==u ^i-^fi %aar e na yr 9 

lation. To this end, the non-lincant** u> the fytfera could be Equation (ix) shows that, due to the last term which can be 

used in encoding the informal**! m the output. The non- negative, O 3 , can become smaller than (O^-fO^) and, with 

linearities can have positive or mc^MU vc ugn as opposed to proper choice of conductivities c 112 and c 212 , even negative, 

unipolar nature of the net (total ) rcvr**ov: from our system- with such an output an XOR operation can be realized in net 

Another useful type of encoding uf the responses from the 10 ioo without any negative polarity in the individual currents 

non-linear conducting layer 102 could be obtained by p*^ Since conventional neural nets require negative connec- 

enhancing high order effects. This enhancement can be ti ons & inhibition to achieve an XOR operation, the result 

achieved by utilizing differential i*Jtpui signals or relative given above shows that the relative responses of non-linear 

output signals. For example, the Knowing encoding conducting layer 102 also carries inhibitory information if 

schemes can be used: 15 the non-linearities are chosen appropriately. Note mat such 

a result would not be possible with a purely linear layer, 

£r r r *" r ' ; (,v ' because the last term in (ix) would men be missing. 

o-ff* /r^ (v> In order to show signal crossing, i.e. a first and a second 

J output signal being each composed of contributions pro- 

<r>6^r y ); ( v 0 20 diiced by more than one input signal, at least two input and 

. . „ . r a two outDUt contacts 104 and 106 are needed. For a simplified 

The fiist option m (^defines coxnponen. J of output stgoal £™* conductill u 102 , Ae encodigVion 

T aS ^^r-^ X^^JSX" <* (v)is chosen. Using above notation where m=0, 1. 2 and 

at an output with index 44 k* and at an output with index *p . w %r» mm n m (d \ \ and fin 

Tne seco^ option in (v) gives me output cornponentj of ^ „ and^Falg^ 

as the current Q"™^^ otteto have signal crossnTg, it needs to be proven that the 
with on/off switch pattern <m The third option of (vi) is the statesare attainable: 

differential output as a function of changes in bias V. that in louuwmB 

itself can be considered as an input signal affecting the (On-^ 7 ,)^ and (O 1 2 -O i2 2 >0; (x) 

response currents as do the input signals X"V The bias ^ , ^ - * ^ * ♦ 

voltage change can be, e.g. a ramped, a sinusoidal or a 30 or, in plain language, that the contribution of me input at 

pulsed excitation. Related to this latter case, one can also contact W dominates the output at contact k=l and that 

encode the information in the amplmide of different signal the contributor toft toe mput at conta* i=l donates the 

harmonics of the bias voltage change. Note that output output at "k=2 w . Proving the validity of conditions (x) is 

functions (ivHvi), and especially (iv) and (v), are rather 35 equivalent to showing that the difference: 
simple and can be implemented easily at the output. A ^ L -p 7 p l (xi) 

threshold current l trvxkoi ^ can be subtracted from any of the 

currents FV for detecting the polarity of the results in each can be negative. For a linear conducting layer 102. this 

case. With these definitions, the encoding described above is condition would translate into a u a^<a 12 a 21 . which is physi- 

analogous to the function of the output neurons in conven- ^ cally unacceptable as a larger current would result from the 

tional Neural Networks. activated input contact farthest away. In order to show that 

It is shown below, with simple examples, that the types of A can plausibly be negative with a non-linear conducting 

encoding (ivMvi) allow for effects like inhibition and signal layer, assume that all linear elements of the linear conduc- 

crossing. To this end, equation (ii) is rewritten as a series tance matrix are equal and that the non-linearities can be 

expansion: 45 treated as small perturbations. With these conditions, A<0 

translates into 

. . . HI- (vu) Cva+Ciu^n+C^ 

To be able to proceed further analytically, consider a non- This last condition can be satisfied easily by sub-linear 
linear conducting plane 102 with only two input contacts ^ (saturating) direct conductances and superlinear cross con- 
104 and two output contacts 106. Then, index m takes the ductances. It is very easy to demonstrate this effect in a "V 
values=0, 1, 2 and 3 for input vectors 2T* (0.0), (1.0), (0.1) resistor network where each branch contains a linear resistor 
and (1,1), respectively. In addition, assume that the non- except one branch that includes a non-linear resistor. If: a) 
linearity in the system is limited to second order terms only. one of the outputs is connected to the non-linear resistor and 
In this case, the currents of (vii) can be written as: 55 the other output to a linear one; and b) one of the inputs is 

connected to the remaining linear resistor and the other to 
rj=T 2 ^Aej^iVHZ*^c Jg X" t !r k V t ]l t (Viii) ue node mcn appUcation of (1,0) and (0,1) inputs can 

Coefficients "a- and "c" used here replace the linear and generate differential (0,1) and (1.0) outputs with proper 
non-linear conductances G. and G 2 , respectively. Equation choice of resistor values and non-lineanty. Similar examples 
(viii) represents a set of eight equations, second-order in V, 60 can be given for the encoding technique stated in (vi). As 
for the two currents. Using equation (viii) and the encoding stated earlier, in this last case, also output harmonics of 
options of (ivHvi). it is shown below how to obtain periodic input signals can be utilized m addition to slopes of 
inhibitory effects and signal crossing in the simplified non- conductance changes, 
linear conducting layer network of the invention with two Physical Operation 

input and two output contacts. 65 

For the first encoding option (iv) there is only one real In order to go into more detail, consider a device with a 

output to consider because, in this case. Cf t i uses the two-dimensional non-linear conducting layer representing 



BNSDOCID: <US 57064O4A1J_> 



5,706,404 

9 10 

an inhomogeneous surface inversion layer in a field effect The capacitances between two puddles are assumed to 

device. II is assumed that this layer is composed of an array depend on the number of carriers contained within these 

of electron puddles with mutually different electron densities puddles and they are given by: 

due to the differences in the surface potential distribution. It Cpdy^i-tfrft* <xwi) 

is shown below that the intrinsic non-linear vector mapping 5 . -j 

abilities of a non-linear surface conducting layer in mis wherein do and d, are constants and q f and q, represent ttie 

simplest form are attained. Any additional features intro- number of charges in puddle "i" and neighbouring puddle 

duced at a later stage will then enhance the effects. The T- This equation simply approximates the fact that 

physics of the device concept studied here may be consid- capacitances, eg.. 306 between puddles containing fewer 

ered to he umilar in nature to the experimental MOS-device 10 charges are smaller. The capacitance 312 between each 

of Shihau mcd ahove However, the prior art device of puddle and ground is taken as a constant No special 

Shihau ool> xr%r> it. implement the synaptic connections attention has been given on fitting the form or the parameters 

for a uncle Seur. * U vharp contrast to the cited art. the appearing in these equations torcal devices. For this, one has 

non-linr« dev-u^o* Uvci in the invention is utilized as a to start with device level equations treating (in this example) 

distributed or««*l uaaJ xnmioc system to act as a full 15 MOS physics properly. This is not necessary for the present 

neural net».«i hn»tr» multiple input and multiple output as only the basic concept of vector mapping in a general 

terminab Ihi» crucial diflcrrmx may require proper encod- non-linear layer is presented. The exact form of the non- 

in g as drwr.hr J >■> Cur prevuw* icction to be able to extract linearities appears to be not crucial to the operation of the 

the require J inloriMtion conducting layer as a vector mapping network. The response 

FIG. $ ^.em-iK-alh illustrate* such a device 300 in the 20 of the model system described above is calculated numen- 

invention. llev.ee functionally comprises an inhomo- cally by using the discretiziscd Poison equation and the 

geneousarmyoldoti representing locations of free electron current continuity equation 

Sddles such a, 302 and 304 in an inhomogeneous surface With the model described above, first the input bias 
mve«fo« lay^ina field eflect device. Puddles 302 and 304 dependence of the conductances, e*. 308 m the layer is 
are tonncd^ napped posiuvc charges within an insulator 25 examined. This is done by apply ui g the «^ ^ 
(not shown/at ihT siface. These electron puddles are at only one of the inputs of the device and obs^g die total 
electrically coupled to one another, here schematically illus- current across the device as a function of the value V oT fee 
trated only f oc L pair of puddles 302 and 304. by means of input bias The results are shown in FIG 7 for moment 
non-linear capachances. e.g.. 306. and non-linear values of the input/output resistances 314 and 316 The basic 
conductances, e^.. 308. Each respective one of the puddles 30 appearance of ftese charac^stic^smnlar to Jhe sub- 
further is capacitively coupled to^ound. indicated here for threshold response of a smgleMOSFCT. Lji fce present case 
a single puddle 310 by way of capacitance 312. The input/ however, we functionally do have accJlceuon ofmtercoo- 
™ sisals are provided at contacts on the periphery via nected floating subthreshold MOSFETs. The rcsutom this 
linear refistccs. of which only resistors 314 ^d 316 are figure can also be ^T^r Z^J^l nT^ro 
shown. As indicated above, the input/output contacts do not 35 tion" through the puddles of the device. There is no sharp 
always have to be at the periphery, but can also be distrib- cut-off to zero current at low biases, in contrast to real 

5 witnin the surface Vrel This latter option may be . percolative models, due to the nonzero temperature param- 
especially beneficial in. for example, image processing eter taken into account in the; calculous, 
applications where the input is Supplied optically to the Next, the ^^^^^^f^ *2g* 
frontal surface as a two^nmensional signal. « 5-output example 400 of device 300 with reference to FIGS 

. * - - . , . . 8. 9 and 10. Device 400 includes a non-linear conducting 

The transport in the layer shown ,n FIG. S ,s modeled by £ » *» conUcU ^ 406 and 408. that 

simplified and normalized equauons approximating the / connected to power supply V through switches 410. 

basic features of the conduction in an inhomogeneous sur- ^ d ^IdTayer 402furth^ncludes fiToutput contacts 

face inversion layer of a large area subthreshold semicon- $16418, 420 ^ md 424 t0 supply response currents 

ductor device For ba^ound infonx^on on Ae physical ^ \pcn6cnt on which ones of^rttehes 410-114 are 

aspects, see Shibata. The non-Unear current flowing among £^ P£ responsc curren ts are fed to a circuit 426 to 

the puddles is given by: determine differential quantities as discussed under equation 

i**.f**v(aW) okO; (jv) above. Note that circuit 426 can simply be a resistance 

l^j=i Ha jT) for a*): (xiii) 50 coupled between two output contacts. The voltage over this 

*"*"' . resistor then is indicative of the net current through the 

wherein \ doIJ represents the net electron current flowing out resistance 

of a puddle, the puddle being denoted by index T. wherein RG 9 g - ves a Table j sho^g me va iues of response 

a is defined by currents 11-15 in predetermined units, e.g.. mA. as a function 

a^Erj-E^jf. ss of input patterns X of open or closed ones of switches 

Ec- being the Fermi level associated with puddle T. Iw., "0-414. J» vector notation. X^Xl^M. X3g .^Xl 

representing die height of the potential barrier between corresponds with the aate of switch 410. X2 corresponds 
pjddle «T and one of its neighbours "j". and wherein T with the state of switch 412 and wherein X3 corresponds 

Sesentsanl^ with the state of swhch 414 Component » ^ 
EL in a real device depends ontiw potential appearing « the associated one of switches 410-414 is closed, thereby 
toween eSon puddlTand is givenby the foUowini connecting power supply V to the appropriate °ne °f con- 

. t . tacts 404-408, and is zero otherwise. Output contact 422 is 

empirical relation: assumed to be disconnected for this example. FIG. 10 gives 

e^^z+I^o-^,^^!-^!; <*v) a x a ble n giving the differential values between currents 12 

wherein E c , is the conduction band edge and b 0 and b, are 65 and II, and between currents D and IS. The information in 

constants. For a representation of these quantities see FIG. Table II is visualized in the diagram of FIG. 11. FIG. 11 

6 clearly demonstrates how output signal 15-13 changes from 
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positive to negative, or. in other words, provides inversion Note that the structure in. FIG. 13 utitos a faMyhomo- 
when the system receives more input signals. Output signal geneous and substantially unrformly ^dj^ammL 
12-11 on the other hand demonstrates the XOR operation, The ^homogeneities induced by the charges trapped in 
and th^efore signal crossing, as the input vectors (100). regions 606-610 are only perturbations superposed onto a 
MloTmto JdWW) produce outputs of +). (+), (-), and 5 homogeneous configuration. This simple arrangement suf- 
-JSlarto ) S^i?3S^ J to. e. g . alevel of 12-11 rices to achieve non-linear and fully distributed mappmg as 
LuaTS ASSuTsSnal is simply produced by way in a conventional neural net. However, substrate 502 may in 
of Wopriai dSSS B subs^ueTlimiting. Other addition contain an array of N-doped regions (not shown 
enco^Tschemes than the one raiding differential here) or heteros^cture regions ^^^^^ 
outputs such as the ones in equations (v) and (vi). give 10 insulating layer 504 m order to enrich 
inversion and signal crossing as well. The output examples properties by providing negative differential resistance or 
given here are obtained after conducting non-linear layer optoelectronic effects. 
402 has reached a steady equiUbrium state. If the output 

current values are probed before such a steady state is ^° ng KJm8C 

reached, then the relative values of the output currents in 15 above mentioned screening effects will occur in 

such a conducting plane can be totally different from the systems that are large in relation to the range of certain 
ones listed in Table JL Intermixing of signals in this transient interactions. These effects will adversely affect the discrimi- 
regime may turn out to be more easily achievable as com- nation between responses to different sets of input signals, 
pared to the intermixing in the steady state situation. Therefore, beyond a given size of the system in the 

A negative-differential-resistance (NDR) effect is attained 20 invention, resolution and noise become important. One way 
in the inhomogeneous inversion layer array by letting die of compensating these drawbacks is to use more contacts to 
current decrease slightly as a function of increasing bias extract more responses that combined produce the output 
voltage difference across the electron puddles. Due to this s ignal(s). Another way, already briefly mentioned above, is 
NDR, the relative locations of output current values are to provide a few long-range interconnects, conductive or 
highly intermixed for different input vector configurations. 25 capacitivc* between various locations distributed over the 
In addition, the input node current values also show such device. This could be attained by a pattern of substantially 
non-linear intermixing. It is obvious that such responses equal conductance distance between the locations intercon- 
result in non-trivial non-linear vector mappings by simple nec ted. FIG. 14 illustrates an example of such an arrange- 
thresholding without the need to apply any of the coding ment 704 that is implemented in a technology similar to that 
methods given in (iv), (v) and (vi). 30 for 5** of FIG. 13. Arrangement 700 is comprised 

FIG. 12 shows a portion of a non-linear inhomogeneous of a semiconductor substrate 702 with a plurality of input 
electrically conducting transport structure 500 for use as a contacts and output contacts 704 and 706, a plurality of 
layer 102 in a neural net of me invention. Structure 500 inhomogeneous domains such as 708 and 710, and a piu- 
inciudes a semiconductor substrate 502, for example of ra iity of long range interconnects such as 712, 714 and 716. 
P-doped silicon, and an electrically insulating layer 504. for 35 LoQg range interconnects 712-716 serve to equalize an 
example silicon dioxide. Layer 504 is provided with charge avenge electrical path length between different ones of 
trapping regions 506. 508, 510. 512, 514 and 516. for input-output contact pairs. Note thai since arrangement 700 
example of noncrystalline silicon or silicon nitride. Elec- is inhomogeneous in large scales as well in a conductive 
trical charges of a predetermined polarity type, positive in state< it is expected that the number of long range intercon- 
this example, trapped in one or more of regions 506-516 40 nccts 712-716 is relatively small. Note that wafer-scale 
induce inversion regions, such as 518, 520. 522 and 524. and integration is a suitable technology to implement vast ver- 
depletion regions, such as 526 and 528 in substrate 502 near sions of such a system, 
insulating layer 504. Trapped electrical charges of the other 

polarity, here negative, induce accumulation regions, such as Learning 

530. in substrate 502 near insulating layer 504. Thus die 45 measures are 

neural net of the invention. Portion 600 mcludes pan of so c synaptic coefficients) of the syn 

previously. An ohmic 2 " 2STdSdo5? signal derroes JmoTquantiQr that is 
N-doped region 616 in *?^»^°J2*L minimized by caging be synaptic coefficients according 
supply an input signal or to traiispc« rcsp^se cun^nt desccutalgorithm. litis method is based on the 
effected at mat location by the mput "^f^f.^" j^Sty of each wuron functionality and of each syn- 
contac* 614 can be used as an additional long range inter- ™ Note that in the present invention indi- 
rection to galvani caU jr- « ff^^Si vSaTnSTll individual syfiapVes cannot be distin- 
more remote areas of substrate 502. e.g.. in order to circum- - £1/ 
wnt ahart ranee effects due to screening. Contacts 618 and guisneo. 

S are^sedal capaAtive inputs to substrate 502. either FIG. 15 gives an example of a neural net in the invention 

such a^f/or indirect via charge storage regions comprising an electrical ^P^^™^*"* 
6«8and 610 Again contacts 618 and 620 are used indi- 65 learning facilities. As structure 800 is partially similar to 
vSua^ tojpptylexu^nally generated input signal or an portion 600. reference is made to FIG. ^ -^discussion 

taterni generated signal by way of feedback mechanism. above for the electrical transport aspects. Structure 800 
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includes a semiconductor substrate 802 of. e.g.. P-doped 
silicon, an electrically insulating layer 804 of, e.g.. silicon 
dioxide, a charge trapping layer 806 of, e.g., polycrystalline 
silicon, islands of polycrystalline silicon embedded in insu- 
lating layer 804. or silicon nitride, a piezoelectric layer 808 
of, e.g.. zinc oxide, for the propagation of mechanical stress 
waves and electrically isolated from layer 806, an insulating 
layer 810 of, e.g., silicon dioxide, and an electrically con- 
ductive layer 812 such as aluminum or tungsten, functioning 
as a (global) gate as in a field effect transistor. 

Learning is as follows. Assume that the initial trapped 
charge distribution in layer 806 gives rise to incorrect 
responses when being given a particular set of predeter- 
mined input signals. Then mechanical stress waves are 
created in piezoelectric layer 808 of finite size. The waves 
may be stochastic. A standing wave pattern is established 
due to reflections throughout layer 808. This in turn pro- 
duces an standing electric field pattern that affects the 
electrical transport properties in substrate 802, in addition to 
the electric field of the trapped charges in layer 806. The 
stress pattern either improves the responses or worsens 
them. If the stress pattern improves the responses, the 
perturbation produced by the associated electric field is 
frozen. The effects of the stress field are replaced by a 
modification of the trapped charge distribution. One way of 
doing this is to apply a bias voltage at global gate 812. Such 
a bias voltage should be just below the threshold of tunnel- 
ling between the charge trapping layer 806 and substrate 
802. This is comparable to the write/era threshold of 
EEPROMs. The electric field produced by the spatially 
varying stress field is added to the constant bias of global 
gate 812. As a result, the total electric field between charge 
trapping layer 806 and substrain 802 is selectively controlled 
to locally exceed or stay below the threshold, thereby 
selectively enabling charge tunnelling. This type of learning 
may be termed "Stochastic Learning**. 

Many variations can be included in the application of the 
bias, stress field and charge trapping. For example, with 
proper design, charging may be achieved by charge transport 
to and from global gate 812. A plurality of mutually elec- 
trically isolated global gates 812 may be provided in a 
predetermined geometrical pattern. Note that, for example, 
GaAs is piezoelectric. An epitaxial GaAs layer separated 
from a GaAs substrate by an insulating layer may provide 
both piezoelectric facilities and electronic signal transport- 
Also layers 806-810 may be replaced by a layer of ferro- 45 
electric material. As known, a ferroele ctric is a material 
having domains whose electric dipole field can be selec- 
tively modified. Ferroelectric materials are used in certain 
types of non-volatile memories. 

FIG. 16 illustrates another example of a layered structure 
900 for use as a cell in a learning neural net in the invention, 
based on opto-ele ctronics. Structure 900 includes a semi- 
conductor substrate 902, for example of P-doped silicon, an 
insulating layer 904, for example of silicon dioxide, and a 
charge trapping region 906, for example of polycrystalline 
silicon, embedded in insulating layer 904. An upper surface 
908 of structure 900 carries electrodes 910 and 912 con- 
nected to opposite poles of a power supply (not shown). 
Electrode 912 is connected to a photodiode 914 and elec- 
trode 910 is connected to a resistor 916. Photodiode 914 and 
resistor 916 are interconnected via a node 918 located near 
charge trapping region 906. Incident light rays 920 on 
photodiode 914 cause the potential at node 918 to change, 
thereby locally affecting the charge distribution in, and 
hence the transport properties of the substrate. In case of an 
improved output (lag) of the neural net due to these changes, 65 
the trapped charge in region 906 is adapted by applying a 
large bias voltage, e.g.. via electrodes 910 and 912, to cause 
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tunnelling between electrodes 910 or 912 and charged 
trapped region 906. 

A plurality of such cells of photodiodes and resisters can 
be arranged in a predetermined configuration, e.g., in a 
rectangular grid or in a radial fashion to imitate the retina, 
in order to enable pattern recognition. Each pixel of an 
image then is mapped onto a corresponding photodiode 
thereby affecting the associated transport properties in terms 
of depletion layers 920 and inversion layers 922. 
I claim: 

1. A neural network processor comprising: 
input means for receiving a plurality of input signals; 
output means for providing at least one output signal; 
neural network means coupled to the input means and the 

output means, the neural network means comprising a 
physical body, the physical body having physical prop- 
erties allowing for propagation of an electrical WAVE 
in an unchanneled fashion therethrough from the input 
means to the output means, the body comprises: 
at least one region, which is suitable for affecting 

electrical conduction through the physical body; 
training means for altering a state of the region during 
a learning mode of the neural network means; and 
wherein: 

the physical body comprises a semiconductor body; 
and 

the semiconductor body comprises: 
a semiconductor substrate; 
an insulating layer on a major surface of the 
substrate; 

at least one charge storage region within the 
insulating layer for inducing the at least one 
region in the substrate. 

2. The processor of claim 1 wherein the training means 
comprises at least one conductor situated on the opposite 
side of the insulating material from the semiconductor 
substrate. 

3. The processor of claim 2 further comprising an addi- 
tional doped region within the semiconductor substrate, 
which doped region is in electrical contact with the 
conductor, via an aperture in the insulating material. 

4. The processor of claim 3 wherein the semiconductor 
substrate has a doping of opposite conducting type to that of 
additional doped region. 

5. The processor of claim 2 wherein the conductor is 
situated directly over the charge storage region and interacts 
capacitively or galvanically therewith. 

6. The processor of claim 2 wherein the conductor is 
situated over a thin portion of the insulating material and 
interacts capacitively or galvanically with the semiconduc- 
tor substrate. 

7. The processor of claim 1 wherein the training means 
comprises 

a piezo-electric layer on the insulating layer for receiving 
mechanical stress waves which alter the electrical prop- 
erties of the piezo-electric layer; 
a second insulating layer on the piezo-electric layer; and 
a conductive layer on the second insulating layer, so that 
the piezo-electric layer alters an effect of the conduc- 
tive layer on the at least one region. 

8. The system of claim 1, wherein the training means 
comprises an upper surface containing photoelectric ele- 
ments for receiving photons for altering electrical properties 
of the upper surface. 

9. The system of claim 1 wherein the training means 
comprises a ferroelectric layer on the insulating layer. 
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ABSTRACT 



An electrochemical synapse adapted for use in a neural 
network which includes an input terminal and an output 
terminal located at a distance of less than 100 microns 
from the input terminal. A permanent interconnect 
having controllable conductivity is located between the 
two inputs. The conductivity of the permanent inter- 
connect is controlled by either growing or eliminating 
metallic whiskers between the inputs. The growth and 
elimination of whiskers provides a rapid and controlla- 
ble electrochemical synapse. Partial neural network 
systems are disclosed utilizing the electrochemical syn- 
apse. 

22 Q aims, 1 Drawing Sheet 
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ELECTROCHEMICAL SYNAPSES FOR 
ARTIFICIAL NEURAL NETWORKS 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates generally to neurons in 
an artificial neural network. More particularly, the pres- 
ent invention relates to solid state, adjustable weight 
synapses for controlling the interaction of the neurons 
in such artificial neural network. 

2. Description of Related Art 

There has been a great deal of interest in developing 
non-volatile associative electronic memories based on 
models of neural networks. A key feature of artificial 
neural networks is the vast number of synapses that 
must interconnect each neuron with many others. 

Several different approaches have been tried for pro- 
viding the vast number of synapses required in any 
artificial neural network. One example is an optical 
approach, wherein light beams can cross one another 
without signal interference and, hence, offer a conve- 
nient way to form multiple interconnections. However, 
the lenses and lasers needed for such optical intercon- 
nective devices make such systems too bulky for broad 
applications. (See, for example, J. Kinoshita and N. G. 
Palevsky, "Computing with Neural Networks," High 
Technology, May, 1987, 24-61, 1987). 

An electrochemically regulated synapse known as 
the "Memistor" was developed in the 1960*s by Bernard 
Widrow, as part of a network known as the "Adaline" 
network, as disclosed by B. Widrow, in the publication 
"Neural Network Theory, Past and Present," Paper 
presented at the DARPA Neural Network Study Sym- 
posium, Lincoln Labs, 1987. The Memistor is an elec- 
trochemical cell in which copper is either plated on or 
deplated from a carbon rod. As a result of the con- 
trolled plating and deplating of copper, the resistance of 
the rod is continuously adjustable from 1-10 ohms. This 
provides a 10:1 range of synaptic "weights." The Me- 40 
mistor serves well from the standpoint of trainability, 
surviving numerous plating and deplating cycles. How- 
ever, the Memistor does not lend itself to miniaturiza- 
tion and the device is not practical for large-scale net- 
works. 45 

Metal migration is an electrochemical process related 
to electroplating. Metal migration takes place between 
conductors in an active electronic circuit in the pres- 
ence of a moisture film. Under the influence of a DC 
voltage, metal ions dissolve from the positive conductor 50 
(the anode). The dissolved ions migrate through the 
moisture film (the electrolyte) and plate out on the 
negative conductor (the cathode). The deposit often 
takes the form of metallic whiskers which eventually 
reach the anode and create an ohmic contact. 55 

Metal migration has been observed with all of the 
metals commonly used in the electronics industry, but it 
occurs most readily with silver (see A. Dermarderosian, 
"The Electrochemical Migration of Metals," Proc. 1978 
Microelectronics Symp^ 134-141, International Soc. for 60 
Hybrid Microelectronics, 1978). The minimum or "crit- 
ical" voltage V c required to grow metallic whiskers can 
range from a few millivolts to over 2 volts, depending 
on the metal and prevailing conditions surrounding the 
electronic circuit. Once V c is exceeded, growth rates 65 
tend to increase linearly with (V— V f ) (see P. B. Price, 
et al„ "On the Growth Properties of Electrolytic Whis- • 
kers," ACTA Met., 6, 1968). The initial contact resis- 
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tance is typically in the range of lOMO 6 ohms, but with 
continued whisker growth, the contact resistance falls 
several orders of magnitude. 

It has been observed that, depending on the medium, 
5 whisker growth between copper conductors proceeds 
either from the cathode to the anode (as usual), or from 
the anode to cathode, which is the reverse of other 
metals (see A. Dermarderosian, "Raw Material Evalua- 
tion through Moisture Resistance Testing," Proc. IPC, 
10 1976). When growth proceeds from anode to cathode, 
the whiskers are known as "Conductive Anodic Fila- 
ments" or CAF (see J. P. Mitchell and T. L. Welsher, 
"Conductive anodic filament growth in printed circuit 
materials," Proc. Printed Circuit World Convention II, 
15 Session 2A, pp. 42-55 (1981); J. N. Lahti, R. H. Dela- 
ney, and J. N. Hines, "The characteristic wearout pro- 
cess in epoxy-glass printed circuits for high density 
electronic packaging," Proc. Reliability Phys. Sympo- 
sium, San Francisco (1979); J. Lando, J. P. Mitchell, 
20 and T. L. Welsher, "Conductive anodic filaments in 
reinforced polymeric dielectrics; formation and preven- 
tion," ibid. (1979); T. L. Welsher, J. P. Mitchell and D. 
J. Lando, "CAF in composite printed circuit substrates: 
M characterization, modeling, and a resistant material", 
Annual Report, Conference on Electrical Insulation and 
Dielectric Phenomena, 234-239 (1980)). 

It has been suggested that the undesirable growth of 
metal whiskers observed in electronic circuits be uti- 
30 lized positively to provide the weighted or adjustable 
synapses in a neural network. Attempts to utilize metal 
whiskers as interconnects or neural network synapses 
were not successful, however, because of the inability 
to reverse the process of whisker growth. In order for 
3 5 metal whisker growth to provide practical synapse 
interconnects, it is crucial that the whisker growth pro- 
cess be reversible. 

In view of the above, it would be desirable to provide 
electrochemically regulated synapses adapted for use in 
neural networks wherein the synapse is a solid state 
configuration which is adapted for miniaturization for 
use in large scale neural networks. 

SUMMARY OF THE INVENTION 

In accordance with the present invention, electro- 
chemical synapses are provided for use in neural net- 
works wherein the electrochemical synapses are solid- 
state devices which are well suited for miniaturization 
to provide the extremely large number of synapses 
which are required for a neural network. The invention 
is based upon providing a permanent interconnect be- 
tween the input and output terminals of a synapse, such 
that the conductivity of the synapse is regulated by 
means of solid-state electrochemistry. 

As one feature of the present invention, the conduc- 
tivity of the permanent interconnect of the synapse is 
regulated by increasing or decreasing the chemical 
reactivity (e.g., pH) of the moisture film absorbed on 
the permanent interconnect. Variations in pH or other 
chemical properties result in variations in whisker 
growth and provide a way to actually reverse metallic 
whisker growth. The ability to vary and even reverse 
whisker growth by controlling chemical properties 
provides a solid-state, electrochemical synapse which is 
especially well suited for use in neural networks. 

As another feature of the present invention, the 
growth of metallic whiskers between the input and 
output terminal of the synapse is controlled by varying 
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the DC voltage applied across the permanent intercon- 
nect. Permanent interconnects made from carbon hav- 
ing an absorbed moisture film present thereon are well 
suited for producing permanent interconnects on which 
metallic whisker growth can be controlled in accor- 
dance with the present invention by pH and DC voltage 
changes. 

As another feature of the present invention, perma- 
nent interconnects are provided which include mixed 
halides of rubidium with copper or silver. Such inter- 
connects are solid-state systems which have conductivi- 
ties that can be reversibly controlled. In addition, ion 
insertion compounds also provide suitable permanent 
interconnects having conductivities which can be regu- 
lated in accordance with the present invention. 

The solid state electrochemical synapses, in accor- 
dance with the present invention, are well suited for use 
in neural networks where the synapse terminals are 
spaced apart at distances of less than 100 microns. The 
rate at which metallic whiskers can be grown or elimi- 20 
nated is such that conductivity over such interterminal 
distances can be rapidly varied to provide the rapid 
changes in synapse memory or weighting required for 
neural networks. 



dium or platinum, and that the other terminal be a mi- 
gratable metal such as copper, bismuth, silver, cad- 
mium, tin, or lead. The permanent interconnect 16 is 
made from a variety of different materials, depending 
5 upon the particular means which is being used for con- 
trollably varying the conductivity of the interconnect 
16. 

A preferred embodiment in accordance with the pres- 
ent invention involves controllably growing metal 
10 whiskers between the terminals in order to provide 
variable conductivity. A carbon channel or other car- 
bon deposited layer is the preferred permanent inter- 
connect for the growth of metal whiskers. The ab- 
sorbed moisture present in the carbon-based permanent 
15 interconnect provides an electrolytic medium in which 
metal whiskers may be grown. Although a number of 
different metal whiskers may be grown in accordance 
with the present invention, copper and silver whiskers 
are preferred. 

As previously mentioned, in certain media, the 
growth of whiskers between copper terminals, can pro- 
ceed in a direction from anode to cathode, which is the 
reverse of other metals. The copper whiskers are then 
known as conductive anodic filaments or CAF. Their 



The above discussed and many other features and 25 th lace b dissolution of the posi- 



attendant advantages of the present invention will be- 
come better understood by reference to the following 
detailed description when taken in conjunction with the 
following drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a schematic representation of a single elec- 
trochemical synapse in accordance with the present 
invention. 



30 



tively biased conductor, migration of the dissolved 
copper ions down the voltage gradient and precipita- 
tion of the copper in the form of a conductive copper 
oxide. 

The precipitation of copper occurs because of pH 
changes associated with parallel electrode reactions 
involving the water present in the electrolytic solution 
provided by the absorbed moisture. Under the influence 



vcimun. . . . . „ of an applied voltage, the water reacts at the anode to 

FIG. 2 is a schematic representation of a simple inter- 35 ° » PP * • 



connect arrangement which includes a plurality of elec 
trochemical synapses in accordance with the present 
invention. 

FIG. 3 is a schematic representation of a multilayer 
interconnect arrangement including a plurality of syn- 
apses in accordance with the present invention. 

DETAILED DESCRIPTION OF INVENTION 
The present invention involves solid-state, electro- 



yield oxygen and hydrogen ions (acid) and at the cath- 
ode to yield hydrogen gas and hydroxyl ions (base). 

The solubility of copper ions decreases as the pH 
rises, so that they remain in solution only in a narrow 
40 zone close to the anode. As the copper ions migrate into 
the more neutral electrolyte displaced away from the 
anode, the copper ions precipitate as the low-density 
oxide filaments. The spongy oxide product fills the 
narrow gap to the anode so that the filaments appear to 



chemical synapses which are adapted for use in neural 45 &cw directly from the anode. 



networks. A preferred exemplary electrochemical syn 
apse in accordance with the present invention is shown 
generally at 10 in FIG. 1. The electrochemical synapse 
includes an input terminal 12, an output terminal 14, and 
a permanent interconnect 16 located therebetween. The 50 
permanent interconnect 16 forms an electrolytic path 
between the input terminal 12 and output terminal 14. 
The permanent interconnect has a small, but finite con- 
ductivity. The input terminal 12 and output terminal 14 
are spaced apart a distance of less than 100 microns. 55 
Preferably, the spacing between the input terminal 12 
and output terminal 14 will be on the order of 5-10 
microns. A DC voltage is provided across the perma- 
nent interconnect 16 by voltage source 18 which is 



The copper oxide whiskers grow preferentially along 
pre-existing paths. This preferred growth path is be- 
lieved to be due to the hygroscopic nature of copper 
oxide which would tend to enhance the absorption of 
moisture. Once a copper oxide whisker connects the 
two electrodes, the resistance falls progressively with 
time. This fact, coupled with the controlling influence 
of pH, provides a capability for controlling whisker 
growth and removal. 

Changes in pH are particularly effective for control- 
ling the growth of CAF. CAF grows by anodic dissolu- 
tion of copper and precipitation of copper oxide at high 
pH. By using a reverse DC bias, in which the anode is 
the non-migratable metal, no metal dissolves and a low 



connected to the input terminal 12 and output terminal 60 pH is produced by the only other possible reaction, the 



14 by way of electrical connections 20 and 22, respec- 
tively. 

The input and output terminals 12 and 14 are made 
from suitable metals, such as gold, indium, palladium, 
platinum, bismuth, silver, cadmium, tin, copper, or lead. 
As will be discussed below, in one embodiment of the 
present invention, it is required that one of the terminals 
be a non-migratable metal such as gold, indium, palla- 



oxidation of water. The resulting acidity redissolves the 
CAF. Experiments have shown that new whiskers tend 
to grow most readily in the presence of already estab- 
lished whiskers. This result indicates a mechanism of 
65 parallel electronic and ionic pathways. Therefore, the 
ionic pathway remains operative in the presence of the 
electronic whisker short and can lead to the gradual 
removal of that short by acid dissolution. 
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Deplating can be carried out in a similar manner. For adsorbed moisture film or electrolyte. The acidity tends 

metals such as silver, cadmium, tin and lead, the reverse to redissolve the material. This leads to reversal ofwhis- 

DC bias dissolves metal from the adjacent whisker ker growth and resulting reductions in conductivity 

n °. 1 T thc u non - ] ml f atable , m etal terminal. Carbon dioxide is particularly preferred for copper 

to replace the wh,sker metal onto the origi- 5 based systems because it can also act as a mild complex- 

SL£^?!£ reverse DC b.as ,s applied mg agent to meUu 30,^,5, other reaaive 

« ft , Tk P I 5 onnccuons ° r " may * gases which may be used to control growth and dissolu! 

applied as a low-level back btxs to al connections in a 5 ~r Li , . , , & , , . " 

system to provide a form of controlled -forge tfZeS* ^1 whisker mcludechlonne, bromine 

In another preferred emboduncnt. the carbon pcr^ ,n uT' ^ T ^ 0 » d ^ h y d ^ en cWo f lde ' 

nent interconnect is replaced M h a solid decuo^te hydr ° gen b ™ 1 ^ hydr0 * Cn mtro « en oxides ' 

such as the mixed halio^es of rubuiium with copper^r *T2^£S? ™»™**>™ ^ t 

silver. (See W. Van Gool. Solid Electrolytes, Academic - , . 2 9X16 3 ^grammatically depict possible mul- 

Press, New York, 1978). Whisker growth then entails * P mterconnect systems utilizing electrochemical 

moving ions in and out of the substrate with no moisture 15 !^ pses m accordance present invention, 

film being required. FIG. 2 illustrates a two dimensional multiple mtercon- 

Solid elecuolytes are pan of a Urge class of materials ncct svstem F 10 - 3 depicts a three-dimensional 

known as ion insertion compound* such as those de- interconnect system. 

scribed by D. F. Shriver and G C. Famngton in "Solid The arrangements illustrated in FIGS. 1-3 may be 
Ionic Conductors", Chem. and Eng. News. May 20, 20 ^P 16111611 ^ ^sm& any state-of-the-art printed wiring 
42-57 (1985). In general, the compounds have both board (PWB), integrated circuit, or hybrid circuit tech- 
ionic and electronic conductivity. Use of these ion in- nologies. For example, the two-dimensional arrange- 
sertion compounds provides the ability to control con- ment shown in FIG. 2 may be constructed using 2-sided 
ductiyity at both a zero level and at much higher levels PWB technology. Three options for constructing the 
utilizing the insertion compounds as a source of ions. 2 5 more complex arrangement shown in FIG. 3 are: multi- 
A particularly preferred ion insertion compound for lay er thick-film technology (using screened conductor 
use as the permanent interconnect is tungsten trioxide. pastes and glass-refractory dielectrics), co-fired multi- 
Tungsten trioxide is a poor conductor when pure, but in layer ceramic technology, and multilayer thin-film 
the presence of moisture and DC voltage, it becomes technology (using metal film conductors and polymer 
eJectrochemically doped with hydrogen ions. This re- 30 dielectrics). 

suits in the formation of a metallic conductor known as Referring to FIG. 2, a two-dimensional design is 

hydrogen tungsten bronze (See P. J. Shaver, Appl. shown generally at 30. Input terminals made of gold are 

Phys. Lett., 1 1 , 255, 1967.) shown at 32. The input terminals 32 are placed together 

The use of an ion insertion compound, such as tung- with bridge terminals 34 made of silver on one side of 

sten trioxide, allows the required reversal and control of 35 the PWB. Output terminals 36, made from gold, are 

metal deposition by the process of corrosion. Specifi- placed on the other side of the PWB. Appropriate 

cally electrons released by metal ionization are scav- traces are shown diagrammatically connecting the gold 

enged by oxygen in the environment surrounding the outputs 36 to the silver bridge terminals 34. The connec- 

mterconnect. In the case of hydrogen tungsten bronze, tions between the output traces 36 and bridges 34 are 

40 preferably made with plated through-holes Utilizing 

electrochemical reaction is: the co^^y methods set ^ orth ^ respe * 

xH 2 o+wo 3 +Xe-=:H wch+xOH- to FIG ' *' wmsker growth and removal are carried out 

* along the paths indicated in FIG. 2 by the dotted lines. 

The balancing reaction at the other electrode is: 3? e resis 1 tance °f «cfa path is regulated independently. 

45 I ne result is a combination of electrochemical synapses 

2H 2 o=02+4H+ +4e- which can be used to provide a neural network. 

A three-dimensional electrochemical synapse system 
The above two reactions proceed from left to right is sh own diagrammatically in FIG. 3 at 40. The system 
during hydrogen entry and from right to left during 40 utmzes multilayer technology wherein inputs 42 and 
hydrogen loss. The slow reaction of hydrogen tungsten 50 out P ut f 44 are laid down as parallel traces on the first 
bronze with oxygen is one example of how manipula- and tnird layers of a multilayer structure. The second 
tion of the environment can be used to gradually layer 46 consists of migratable bridge traces laid down 
weaken a synapse to provide a controlled rate of con- at ri S ht angles to inputs 42 and outputs 44. Paths be- 
ductivity. General exposure to oxygen, therefore, tween the three sets of traces are defined by forming 
causes a homogenous conversion of H*W03 to WO3 as 55 vertical vias at the crossing points and filling them with 
an alternative to the rapid (approximately one second) an ion insertion material as previously described. Inter- 
electrochemical reversal process. connections are then grown and removed by the tech- 
Exposure to oxygen can also be used to dissolve me- niques previously described, 
tallic whiskers in the presence of hydrogen ions e.g.: Tne Mack heavy lines interconnecting the inputs 42, 

60 bridge 46 and outputs 44 in FIG. 3 illustrates how inter- 
2H+ + 1/202+M — M 2 +H 2 0 connections are established for one exemplary bridge. 
. w The thickness of the black interconnecting lines depicts 
where M represents any non-noble metal, such as cop- different levels of conductivity as regulated in accor- 
per, nickel, iron, zinc, or cadmium. dance with the present invention. Preferably, there are 
There are several other examples in which the con- 65 enough bridge traces to allow each input 42 to be con- 
ductivity of the interconnect is regulated by means of nected with every output 44 and vice versa, 
reactive gases. One example involves the use of an FIGS. 2 and 3 are representative portions of large 
acidic gas such as carbon dioxide to lower the pH of the neural networks having many synaptic junctions. The 
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operation of such large-scale neural networks requires terminals comprises a non-migratable metal and the 
short cycle times for training the synaptic junctions. other of said input or output terminals comprises a mi- 
The exact rates of whisker growth and removal in ac- gratable metal. 

cordance with the present invention depend on the 5. An electrochemically regulated interconnection 
factors previously described. 5 according to claim 4 wherein said non-migratable metal 

Preferably, the whisker growth and removal rate will is selected from the group consisting of gold, indium, 
allow growth and removal cycle times of a few seconds. palladium and platinum and said migratable metal is 
For example, the growth or removal rate of a metal selected from the group consisting of bismuth, silver, 
whisker is proportional to the current density in am- cadmium, tin and lead. 

peres per square centimeter at the whisker tip. Al- 10 6. An electrochemically regulated interconnection 
though the total current may be minuscule, the small according to claim 1 wherein said permanent uitercon- 
diameter of a whisker, typically a fraction of a micron, nect comprises carbon and moisture absorbed on the 
yields current densities of ten amps per square centime- surface of said carbon. 

ter or more. For a metal valence z, and atomic weight 7. An electrochemically regulated interconnection 
W and a density of p grams per cubic centimeter, a 15 according to claim 1 wherein said permanent lntercon- 
current density of 10 amps per square centimeter corre- nect comprises mixed halides of rubidium with copper 
spends to a tip velocity of 10 W/zF p cm/sec where F or silver. 

is the Faraday constant. * An electrochemically regulated interconnection 

If silver anodes are used, a tip velocity of 10.6 mi- according to claim 1 wherein said permanent intercon- 
crons per second is achievable in accordance with the 20 nect comprises an ion insertion compound, 
present invention. When nickel is used as a migratable 9. An electrochemically regulated interconnection 
terminal, the growth velocity at the whisker tip is 3.4 according to claim 1 wherein said permanent intercon- 
microns per second. Growth rates of these magnitudes nect comprises carbon and moisture absorbed on the 
and even higher are possible in accordance with the surface of said carbon. 

present invention. 25 10. An electrochemically regulated interconnection 

In large scale neural networks, the interconnection according to claim 9 wherein said input and output 
path length will be under 100 microns and preferably no terminals comprise copper. 

more than a few microns. Accordingly, cycle times for 11. A method for operating an electrochemical mter- 
growth and removal of whiskers in accordance with the connection for use in a neural network wherein said 
present invention will be on the order of one second or 30 electrochemical interconnection includes a permanent 
j ess interconnect between an input terminal and an output 

Having thus described exemplary embodiments of the terminal, said permanent interconnect having a pH, 
present invention, it should be noted by those skilled in conductivity and comprising a migratable metal which 
the art that the within disclosures are exemplary only forms whiskers along said permanent interconnect, said 
and that various other alternatives, adaptations and 35 method comprising the step of controllably increasing 
modifications may be made within the scope of the or decreasing the conductivity of said permanent uiter- 
present invention. Accordingly, the present invention is connect by increasing or decreasing the pH of said 
not limited to the specific embodiments as illustrated permanent interconnect to thereby control growth of 
herein, but is only limited by the following claims. said metallic whiskers between said input terminal and 

What is claimed is: 40 said output terminal. 

1. An electrochemically regulated interconnection 12. A method for operating an electrochemical inter- 
adapted for use in a neural network, said interconnec- connection according to claim 11 wherein said conduc- 
tion comprising: tivity is controllably increased or decreased by varying 

an input terminal; a DC voltage applied across said permanent intercon- 

an output terminal located at a distance of less than 45 nect. 

100 microns from said input terminal; 13. A method for operating an electrochemical inter- 

a permanent interconnect between said input and connection according to claim 12 further comprising 
output terminals, said permanent interconnect hav- means for reversing the bias of said DC voltage, 
ing a pH, a conductivity and comprising a migrata- 14. A method for operating an electrochemical inter- 
ble metal which forms whiskers along said perma- 50 connection according to claim 12 wherein one of said 
nent interconnect; and input or output terminals comprises a non-migratable 

conductivity control means for regulating the con- metal and the other of said input or output terminals 
ductivity of said permanent interconnect, said con- comprises a migratable metal. 

ductivity control means comprising means for in- 15. A method for operating an electrochemical inter- 
creasing or decreasing the pH of said permanent 55 connection according to claim 14 wherein said non- 
interconnect thereby reversibly controlling the migratable metal is selected from the group consisting 
growth of said metallic whiskers. of gold, indium, palladium and platinum and said migra- 

2. An electrochemically regulated interconnection table metal is selected from the group consisting of 
according to claim 1 which additionally includes means bismuth, silver, cadmium, tin and lead. 

for applying a DC voltage across said permanent inter- 60 16. A method for operating an electrochemical inter- 
connect, said conductivity control means comprising connection according to claim 11 wherein said step of 
means for increasing or decreasing the DC voltage controllably increasing or decreasing said conductivity 
applied across said permanent interconnect. comprises exposing said permanent interconnect to a 

3. An electrochemically regulated interconnection corrosive gas. 

according to claim 3 further comprising means for re- 65 17. A method for operating an electrochemical inter- 
versing the bias of said DC voltage. connection according to claim 11 wherein said perma- 

4. An electrochemically regulated interconnection nent interconnect comprises carbon and moisture ab- 
according to claim 2 wherein one of said input or output sorbed on the surface of said carbon. 
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18. A method for operating an electrochemical inter* conductivity control means for regulating the con- 
connection according to claim 17 wherein said input ductivity of said interconnect by increasing or de- 
and output terminals comprise copper. creasing the pH of said interconnect; and 

19. A method for operating an electrochemical inter- means for applying a DC voltage across said perma- 
connection according to claim 11 wherein said perma- 5 nent interconnect, said conductivity control means 
nent interconnect comprises mixed halides of rubidium comprising means for increasing or decreasing the 
with copper or silver. DC volta S e a PP hed across P^nnanent inter- 

A < connect. 

20. A method for operating an electrochemical inter- 22 . A method for operating an electrochemical inter- 
connection according to claim 11 wherein said perma- 10 connection for use in a neural network wherein said 
nent mterconnect comprises an ion insertion compound. electrochemical interconnection includes a permanent 

21. An electrochemically regulated interconnection interconnect between an input terminal and an output 
adapted for use in a neural network, said interconnec- terminal wherein one of said input or output terminals 
tion comprising: comprises a non-migratable metal and the other of said 

an input terminal; IS input or output terminals comprises a migratable metal 

an output terminal located at a distance of less than and wnerein said permanent interconnect has a pH and 

100 microns from said input terminal wherein one a conductivitv > s«d method comprising the step of con- 

of said input or output terminals comprises a non- tr ?] labI y increasing or decreasing the conductivity of 

migratable metal and the other of said input or , n » d P*™?* mterconnect by increasing or decreas- 

t^i^ic ™ • ' IT p , ur 20 mg the pH of said permanent interconnect, said mcrease 

output terminals comprises a migratable metal; or decrease in said conductivity being achieved by 

a permanent interconnect between said input and varying the DC voltage applied across said intercon- 

output terminals, said interconnect having a con- nect. 

ductivity and a pH; * * * * * 
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